[ 512.530848] env[65143]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 512.530848] env[65143]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 513.516347] env[65231]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 513.516347] env[65231]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 515.091942] env[65231]: INFO neutron.common.config [-] Logging enabled! [ 515.092379] env[65231]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev40 [ 515.092506] env[65231]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65231) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 515.092811] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 515.092908] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 515.093789] env[65231]: WARNING oslo_policy.policy [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 515.093990] env[65231]: WARNING oslo_policy.policy [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 515.095712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] VMware NSXv3 Agent initialized successfully. [ 515.096087] env[65231]: DEBUG oslo_concurrency.lockutils [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Acquiring lock "singleton_lock" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 515.096263] env[65231]: DEBUG oslo_concurrency.lockutils [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Acquired lock "singleton_lock" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 515.096429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Releasing lock "singleton_lock" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 515.096722] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Full set of CONF: {{(pid=65231) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 515.096836] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ******************************************************************************** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 515.096937] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Configuration options gathered from: {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 515.097310] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 515.097491] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 515.097593] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ================================================================================ {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 515.097759] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] agent_down_time = 75 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.097895] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] allow_automatic_dhcp_failover = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098037] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] allow_bulk = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098181] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] api_extensions_path = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098351] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] api_paste_config = api-paste.ini {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098497] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] auth_strategy = keystone {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098601] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] backdoor_port = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098701] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] backdoor_socket = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098831] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] backlog = 4096 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.098962] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099134] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] bind_host = 0.0.0.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099303] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] bind_port = 9696 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099467] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] client_socket_timeout = 900 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099612] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] config_dir = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099720] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099856] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] config_source = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.099995] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] control_exchange = neutron {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100151] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] core_plugin = ml2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100287] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] debug = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100420] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] default_availability_zones = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100625] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100757] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dhcp_agent_notification = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.100889] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dhcp_agents_per_network = 1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101030] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dhcp_lease_duration = 86400 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101175] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dhcp_load_type = networks {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101308] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dns_domain = openstacklocal {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101443] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101573] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_default_route_bfd = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101698] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_default_route_ecmp = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101824] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_dvr = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.101950] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_new_agents = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102094] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102223] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_signals = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102352] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] enable_traditional_dhcp = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102482] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] external_dns_driver = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102611] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] filter_validation = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102748] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] global_physnet_mtu = 8950 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.102912] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] graceful_shutdown_timeout = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103078] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] host = cpu-1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103215] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] host_dvr_for_dhcp = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103346] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] http_retries = 3 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103487] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] instance_format = [instance: %(uuid)s] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103618] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103751] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ipam_driver = internal {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.103877] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ipv6_pd_enabled = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104012] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] l3_ha = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104150] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104283] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] l3_ha_network_physical_name = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104414] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] l3_ha_network_type = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104547] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_color = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104678] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_config_append = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104810] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.104934] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_dir = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105071] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_file = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105174] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_options = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105306] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_rotate_interval = 1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105450] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_rotate_interval_type = days {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105580] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] log_rotation_type = none {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105683] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105782] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.105915] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106059] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106159] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106291] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_dns_nameservers = 5 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106417] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_header_line = 16384 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106542] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_l3_agents_per_router = 3 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106665] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_logfile_count = 30 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106789] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_logfile_size_mb = 200 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.106914] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] max_subnet_host_routes = 20 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107055] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] my_ip = 10.180.1.21 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107188] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] my_ipv6 = ::1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107315] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] network_auto_schedule = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107448] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] network_link_prefix = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107578] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107710] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] notify_nova_on_port_data_changes = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107843] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] notify_nova_on_port_status_changes = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.107974] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] pagination_max_limit = -1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108112] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] publish_errors = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108266] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rate_limit_burst = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108398] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rate_limit_except_level = CRITICAL {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108529] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rate_limit_interval = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108656] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] retry_until_window = 30 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108785] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] router_distributed = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.108915] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rpc_resources_processing_step = 20 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109053] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rpc_response_max_timeout = 600 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109186] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] rpc_response_timeout = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109336] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] send_events_interval = 2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109506] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] service_plugins = ['router'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109643] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] setproctitle = on {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109763] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] shell_completion = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.109896] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] state_path = /opt/stack/data/neutron {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110041] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] syslog_log_facility = LOG_USER {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110176] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] tcp_keepidle = 600 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110307] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] transport_url = **** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110437] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] use_journal = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110563] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] use_json = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110693] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] use_ssl = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110820] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] use_stderr = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.110954] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] use_syslog = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111091] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vlan_qinq = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111218] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vlan_transparent = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111346] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] watch_log_file = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111477] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] wsgi_default_pool_size = 100 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111605] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] wsgi_keep_alive = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111738] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.111864] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] wsgi_server_debug = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 515.112018] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_concurrency.disable_process_locking = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112159] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112300] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112432] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112567] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112701] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112833] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.112978] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.connection_string = messaging:// {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113126] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.enabled = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113268] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.es_doc_type = notification {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113407] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.es_scroll_size = 10000 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113545] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.es_scroll_time = 2m {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113676] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.filter_error_trace = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113813] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.hmac_keys = **** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.113951] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.sentinel_service_name = mymaster {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114107] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.socket_timeout = 0.1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114247] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.trace_requests = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114378] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler.trace_sqlalchemy = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114519] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler_jaeger.process_tags = {} {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114649] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler_jaeger.service_name_prefix = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114780] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] profiler_otlp.service_name_prefix = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.114924] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.enforce_new_defaults = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.115214] env[65231]: WARNING oslo_config.cfg [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 515.115362] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.enforce_scope = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.115507] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.policy_default_rule = default {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.115655] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.115793] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.115933] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116078] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116212] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116345] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116474] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116608] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116799] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.116982] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] agent.extensions = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117141] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117284] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] service_providers.service_provider = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117432] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.default_quota = -1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117578] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117715] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_floatingip = 50 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117847] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_network = 100 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.117979] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_port = 500 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118126] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118281] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_router = 10 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118420] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_security_group = 10 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118554] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118687] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.quota_subnet = 100 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118817] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] QUOTAS.track_quota_usage = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.118963] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119108] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119243] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119422] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119571] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119708] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119840] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.119982] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120126] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120255] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120387] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120520] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120650] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120781] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_dhcp_release.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.120920] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121060] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121191] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121319] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121455] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121585] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121713] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_ovs_vsctl.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121849] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.capabilities = [21] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.121975] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122113] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122245] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122382] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122515] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122640] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_namespace.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122776] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.capabilities = [12] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.122900] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123036] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123169] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123303] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123436] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123561] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_conntrack.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123699] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.capabilities = [12, 21] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123829] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.group = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.123953] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.helper_command = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124115] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.log_daemon_traceback = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124256] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124389] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.thread_pool_size = 8 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124517] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] privsep_link.user = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124671] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124814] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.124951] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.continue_on_failed_promotions = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125093] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.dscp = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125232] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.dscp_inherit = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125376] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.force_mp_to_policy = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125513] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.locking_coordinator_url = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125653] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.log_agent_heartbeats = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.125853] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.logging_expire = 1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126024] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126519] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126519] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.polling_interval = 240 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126519] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126898] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126898] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.report_interval = 30.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126898] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.126994] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127360] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127360] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.sync_skew = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127360] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.synchronization_queue_size = 20 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127523] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT.use_helper_for_ns_read = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127631] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] SECURITYGROUP.enable_ipset = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127839] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] SECURITYGROUP.enable_security_group = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.127909] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.128047] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.128188] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] experimental.ipv6_pd_enabled = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.128364] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.extension_drivers = ['port_security'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.128504] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.external_network_type = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.128655] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129466] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.overlay_ip_version = 4 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129466] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.path_mtu = 8950 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129466] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.physical_network_mtus = {} {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129466] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129466] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129776] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ml2.type_drivers = ['vlan'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129776] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129776] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.129910] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.130026] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.130166] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.130673] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.130673] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.130673] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131108] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131108] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131108] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_login_password = **** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131243] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131291] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_login_user = admin {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131429] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131567] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131701] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131831] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.131966] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132119] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132258] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132394] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132525] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132659] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132800] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.132931] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133077] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133265] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133408] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133547] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133674] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133810] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.auth_section = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.133952] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.auth_type = password {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134102] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134233] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.certfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134365] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.collect_timing = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134509] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.endpoint_type = public {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134639] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.insecure = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134764] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.keyfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.134900] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.region_name = RegionOne {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135042] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.split_loggers = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135176] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] nova.timeout = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135312] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.auth_section = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135455] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.auth_type = password {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135593] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135723] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.certfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135855] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.collect_timing = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.135993] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.endpoint_type = public {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136140] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.insecure = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136269] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.keyfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136399] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.region_name = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136527] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.split_loggers = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136654] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] placement.timeout = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136787] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.auth_section = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.136920] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.auth_type = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137059] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.cafile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137190] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.certfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137322] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.collect_timing = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137452] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.connect_retries = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137581] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.connect_retry_delay = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137711] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.enable_notifications = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137839] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.endpoint_override = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.137968] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.insecure = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138113] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.interface = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138246] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.keyfile = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138398] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.max_version = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138532] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.min_version = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138661] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.region_name = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138789] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.retriable_status_codes = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.138914] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.service_name = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139053] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.service_type = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139186] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.split_loggers = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139311] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.status_code_retries = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139462] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.status_code_retry_delay = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139594] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.timeout = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139720] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.valid_interfaces = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139844] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ironic.version = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.139979] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] cli_script.dry_run = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140133] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140264] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140396] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140524] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140655] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140785] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.140914] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141055] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141186] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141325] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141454] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141591] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141731] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141867] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.141999] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142150] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142286] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142418] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142555] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142687] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142817] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.142950] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143094] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143228] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143360] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143494] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143627] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143755] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.143883] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144021] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144156] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144294] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144432] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144562] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.144862] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145032] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145171] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145314] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_notifications.driver = [] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145452] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_notifications.retry = -1 {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145598] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145728] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 515.145834] env[65231]: DEBUG oslo_service.backend._eventlet.service [None req-6cb245c5-1736-4695-a778-575cb7837fc9 None None] ******************************************************************************** {{(pid=65231) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 515.147033] env[65231]: DEBUG neutron.agent.securitygroups_rpc [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Init firewall settings (driver=nsxv3) {{(pid=65231) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 515.148399] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65231) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 515.148630] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] RPC agent_id: nsxm-l-01a.corp.local [ 515.150889] env[65231]: DEBUG dogpile.cache.region [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 515.151012] env[65231]: DEBUG dogpile.lock [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 515.151117] env[65231]: DEBUG dogpile.lock [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 515.151206] env[65231]: DEBUG dogpile.lock [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 515.151296] env[65231]: DEBUG dogpile.cache.region [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 515.151383] env[65231]: DEBUG dogpile.lock [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 515.151504] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 515.191783] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Session token - acquiring [ 515.193319] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 515.193505] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 515.193576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 515.194037] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 515.205709] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 515.499982] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 515.522716] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 515.522874] env[65231]: DEBUG dogpile.cache.region [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Cache value generated in 0.371 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 515.522927] env[65231]: DEBUG dogpile.lock [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 515.523027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Activating Policy API Provider. [ 515.523229] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Looking for the default Infrastructure Rules. [ 515.589358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Looking for the Default Layer3 Logged Drop Section. [ 515.605511] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 515.605982] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 515.606164] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 515.606268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 515.606554] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 515.606904] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 516.122601] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 516.625542] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 517.128725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Inventory metadata is going to be refreshed. [ 517.128725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 517.896036] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.896036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.896036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.896036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.906767] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 517.907861] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.908620] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 517.929027] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.929027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.929027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.929027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.929027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.929027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 517.929027] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 517.929027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 517.949615] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.950295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.950555] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.951057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.952664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.952664] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 517.976760] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.976760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.976760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.976760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.976760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.976760] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 517.998917] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.998917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.998917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.998917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.998917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.998917] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 517.998917] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 517.998917] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 518.018595] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 518.018595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 518.018595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 518.018595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 518.018595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 518.018595] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 518.018595] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 518.018595] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 518.040027] env[65231]: DEBUG networking_nsxv3.common.locking [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 518.040027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 518.040027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 518.040027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 518.040027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 518.040027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 518.040027] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 518.040027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Inventory metadata have been refreshed. [ 518.040027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Dryrun:True. Metadata refresh completed. [ 518.040027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Releasing lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 518.041899] env[65231]: INFO neutron.agent.agent_extensions_manager [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Loaded agent extensions: [] [ 518.042876] env[65231]: DEBUG neutron_lib.callbacks.manager [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65231) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 518.094562] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent RPC Daemon Started! [ 518.094562] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:0 started [ 518.094562] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent out of sync with plugin! [ 520.047555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.047555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 520.047555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 520.047555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 520.047555] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 520.551088] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.053214] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.555716] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 521.555924] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 522.309349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.309803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.309803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.309803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.321687] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 522.322491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.323130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 522.339270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.339492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.339492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.339669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.339754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.339860] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 522.339931] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 522.340001] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 522.358324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.358540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.358540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.358739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.358869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.358970] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 522.378609] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.378787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.378787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.378990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.379105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.379212] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 522.399358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.399603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.399603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.399759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.399863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.399978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 522.400055] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 522.400123] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 522.418019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.418255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.418255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.418496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.418581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.418688] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 522.418760] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 522.418830] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 522.438056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.438238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.438238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.438468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.438568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.438675] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 522.438746] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 522.438812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 522.438874] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 522.438946] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 522.439019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 522.439079] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 522.439329] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 522.439393] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 522.439468] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 522.461378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.461575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.461575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.461757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.461856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.461957] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 522.484503] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.484712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.484712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.484899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.485009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.514454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.043811] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 523.043975] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 528.044947] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 528.045318] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 533.045994] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.046401] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 533.298278] env[65231]: INFO networking_nsxv3.common.synchronization [None req-228b8428-482d-4e45-b984-900cc3776b26 demo admin] Enqueued Resource ID: 4af984e8-e39a-45ca-ae18-d5cd75391587 with Priority: HIGHEST for action security_group_rules [ 533.298598] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4af984e8-e39a-45ca-ae18-d5cd75391587 with Priority: HIGHEST for action security_group_rules [ 533.298899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4af984e8-e39a-45ca-ae18-d5cd75391587 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.299035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4af984e8-e39a-45ca-ae18-d5cd75391587" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.299105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4af984e8-e39a-45ca-ae18-d5cd75391587" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.299373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4af984e8-e39a-45ca-ae18-d5cd75391587" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.299488] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4af984e8-e39a-45ca-ae18-d5cd75391587',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.821759] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.822034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.822034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.822215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.822271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.822400] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4af984e8-e39a-45ca-ae18-d5cd75391587 already deleted. [ 533.822493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4af984e8-e39a-45ca-ae18-d5cd75391587" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.299306] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.300098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.301510] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.301728] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.302405] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.302861] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.305069] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.305069] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.304834] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.305164] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.385051] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b52bbf67-685d-4474-9c5f-ebc795d70763 None None] Enqueued Resource ID: d2b75a98-959e-4255-a6ba-b3b65ca68210 with Priority: HIGHEST for action port [ 559.385665] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b75a98-959e-4255-a6ba-b3b65ca68210 with Priority: HIGHEST for action port [ 559.385967] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2b75a98-959e-4255-a6ba-b3b65ca68210 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.386104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2b75a98-959e-4255-a6ba-b3b65ca68210" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.386166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2b75a98-959e-4255-a6ba-b3b65ca68210" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.386528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2b75a98-959e-4255-a6ba-b3b65ca68210" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.386691] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2b75a98-959e-4255-a6ba-b3b65ca68210',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.893019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2b75a98-959e-4255-a6ba-b3b65ca68210 [ 559.893019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.893019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.893019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.893019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.893019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.893019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2b75a98-959e-4255-a6ba-b3b65ca68210 already deleted. [ 559.893019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2b75a98-959e-4255-a6ba-b3b65ca68210" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.263198] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2e2b3860-8035-4d21-a9a9-079edb4518ec None None] Enqueued Resource ID: 21874b1f-4e20-4c3c-a232-7a58115696e9 with Priority: HIGHEST for action port [ 561.263198] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21874b1f-4e20-4c3c-a232-7a58115696e9 with Priority: HIGHEST for action port [ 561.263198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-21874b1f-4e20-4c3c-a232-7a58115696e9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.263886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21874b1f-4e20-4c3c-a232-7a58115696e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.264076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21874b1f-4e20-4c3c-a232-7a58115696e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.264472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21874b1f-4e20-4c3c-a232-7a58115696e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.264731] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21874b1f-4e20-4c3c-a232-7a58115696e9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.767692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21874b1f-4e20-4c3c-a232-7a58115696e9 [ 561.767928] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.768238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.768238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.768348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.768464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.768540] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21874b1f-4e20-4c3c-a232-7a58115696e9 already deleted. [ 561.768675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21874b1f-4e20-4c3c-a232-7a58115696e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.064698] env[65231]: INFO networking_nsxv3.common.synchronization [None req-81a86d3c-b912-4511-a986-1b05d4263463 None None] Enqueued Resource ID: afafd11d-0362-4eaa-bd27-c85924596ac1 with Priority: HIGHEST for action port [ 562.065471] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afafd11d-0362-4eaa-bd27-c85924596ac1 with Priority: HIGHEST for action port [ 562.065995] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-afafd11d-0362-4eaa-bd27-c85924596ac1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.065995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afafd11d-0362-4eaa-bd27-c85924596ac1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.066198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afafd11d-0362-4eaa-bd27-c85924596ac1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.066388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afafd11d-0362-4eaa-bd27-c85924596ac1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.066474] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afafd11d-0362-4eaa-bd27-c85924596ac1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.569477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afafd11d-0362-4eaa-bd27-c85924596ac1 [ 562.569893] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.570027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.570419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.570419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.570569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.570569] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afafd11d-0362-4eaa-bd27-c85924596ac1 already deleted. [ 562.570628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afafd11d-0362-4eaa-bd27-c85924596ac1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.396722] env[65231]: INFO networking_nsxv3.common.synchronization [None req-72a72131-6648-4f68-b0fe-855ce16b7233 None None] Enqueued Resource ID: f653971a-c724-4102-9aa2-b1d72a80a21e with Priority: HIGHEST for action port [ 564.397177] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f653971a-c724-4102-9aa2-b1d72a80a21e with Priority: HIGHEST for action port [ 564.397506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f653971a-c724-4102-9aa2-b1d72a80a21e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.397572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f653971a-c724-4102-9aa2-b1d72a80a21e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.397637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f653971a-c724-4102-9aa2-b1d72a80a21e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.397879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f653971a-c724-4102-9aa2-b1d72a80a21e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.398084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f653971a-c724-4102-9aa2-b1d72a80a21e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.902125] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f653971a-c724-4102-9aa2-b1d72a80a21e [ 564.902125] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.902125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.902125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.902125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.902125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.902125] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f653971a-c724-4102-9aa2-b1d72a80a21e already deleted. [ 564.902125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f653971a-c724-4102-9aa2-b1d72a80a21e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.125334] env[65231]: INFO networking_nsxv3.common.synchronization [None req-68c8058a-6540-4a31-a305-d5711c6162e6 None None] Enqueued Resource ID: 1a20fef3-7063-4c3a-9199-507201dc585d with Priority: HIGHEST for action port [ 566.125590] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a20fef3-7063-4c3a-9199-507201dc585d with Priority: HIGHEST for action port [ 566.126443] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a20fef3-7063-4c3a-9199-507201dc585d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.126443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a20fef3-7063-4c3a-9199-507201dc585d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.126443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a20fef3-7063-4c3a-9199-507201dc585d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.126908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a20fef3-7063-4c3a-9199-507201dc585d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.126908] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a20fef3-7063-4c3a-9199-507201dc585d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.485483] env[65231]: INFO networking_nsxv3.common.synchronization [None req-71a10e11-5fec-4d3b-b17d-c5b3ee96040e None None] Enqueued Resource ID: 35b56ab2-8c51-46f7-9a96-51c8fdb41791 with Priority: HIGHEST for action port [ 566.485891] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b56ab2-8c51-46f7-9a96-51c8fdb41791 with Priority: HIGHEST for action port [ 566.486248] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-35b56ab2-8c51-46f7-9a96-51c8fdb41791 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.486383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35b56ab2-8c51-46f7-9a96-51c8fdb41791" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.486440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35b56ab2-8c51-46f7-9a96-51c8fdb41791" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.486698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35b56ab2-8c51-46f7-9a96-51c8fdb41791" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.486779] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b56ab2-8c51-46f7-9a96-51c8fdb41791',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.632023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a20fef3-7063-4c3a-9199-507201dc585d [ 566.632023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.632023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.632023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.632023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.632023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.632023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a20fef3-7063-4c3a-9199-507201dc585d already deleted. [ 566.632023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a20fef3-7063-4c3a-9199-507201dc585d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.991677] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35b56ab2-8c51-46f7-9a96-51c8fdb41791 [ 566.991677] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.991677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.991677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.991677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.991677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.991677] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35b56ab2-8c51-46f7-9a96-51c8fdb41791 already deleted. [ 566.991677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35b56ab2-8c51-46f7-9a96-51c8fdb41791" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.298539] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9113d97c-8606-4ef7-a580-0c17c4f2c66e None None] Enqueued Resource ID: 05b13d51-e8a2-4b53-ba63-9079ffb26813 with Priority: HIGHEST for action port [ 567.299184] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b13d51-e8a2-4b53-ba63-9079ffb26813 with Priority: HIGHEST for action port [ 567.299873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-05b13d51-e8a2-4b53-ba63-9079ffb26813 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.299873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05b13d51-e8a2-4b53-ba63-9079ffb26813" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.299873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05b13d51-e8a2-4b53-ba63-9079ffb26813" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.301143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05b13d51-e8a2-4b53-ba63-9079ffb26813" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.301143] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05b13d51-e8a2-4b53-ba63-9079ffb26813',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.803043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05b13d51-e8a2-4b53-ba63-9079ffb26813 [ 567.803129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.803256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.803326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.803547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.803681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.803826] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05b13d51-e8a2-4b53-ba63-9079ffb26813 already deleted. [ 567.803958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05b13d51-e8a2-4b53-ba63-9079ffb26813" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.974226] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2766ecba-b319-4d0b-bb38-37a23ca69e63 None None] Enqueued Resource ID: 5be432f3-10ee-49cd-8038-1262ddcc242c with Priority: HIGHEST for action port [ 567.974502] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be432f3-10ee-49cd-8038-1262ddcc242c with Priority: HIGHEST for action port [ 567.975334] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5be432f3-10ee-49cd-8038-1262ddcc242c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.975484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5be432f3-10ee-49cd-8038-1262ddcc242c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.975569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5be432f3-10ee-49cd-8038-1262ddcc242c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.975824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5be432f3-10ee-49cd-8038-1262ddcc242c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.975901] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be432f3-10ee-49cd-8038-1262ddcc242c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.478187] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5be432f3-10ee-49cd-8038-1262ddcc242c [ 568.478668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.478668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.478668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.478852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.478942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.479050] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5be432f3-10ee-49cd-8038-1262ddcc242c already deleted. [ 568.479153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5be432f3-10ee-49cd-8038-1262ddcc242c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.690877] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d817f8dc-bfa9-43df-89c4-9f9fdef484b5 None None] Enqueued Resource ID: a9d6ab30-bc39-486e-a434-433118b69d8f with Priority: HIGHEST for action port [ 568.691172] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d6ab30-bc39-486e-a434-433118b69d8f with Priority: HIGHEST for action port [ 568.691492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d6ab30-bc39-486e-a434-433118b69d8f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.691619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d6ab30-bc39-486e-a434-433118b69d8f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.691727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d6ab30-bc39-486e-a434-433118b69d8f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.691942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d6ab30-bc39-486e-a434-433118b69d8f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.692000] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d6ab30-bc39-486e-a434-433118b69d8f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.698068] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a6120d69-9542-4a7e-aad2-244c31d9d948 None None] Enqueued Resource ID: 79c9067f-77f2-4089-9aa3-3160d9740d43 with Priority: HIGHEST for action port [ 568.698608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c9067f-77f2-4089-9aa3-3160d9740d43 with Priority: HIGHEST for action port [ 568.701724] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-79c9067f-77f2-4089-9aa3-3160d9740d43 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.701724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79c9067f-77f2-4089-9aa3-3160d9740d43" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.701724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79c9067f-77f2-4089-9aa3-3160d9740d43" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.701724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79c9067f-77f2-4089-9aa3-3160d9740d43" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.701724] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79c9067f-77f2-4089-9aa3-3160d9740d43',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.196114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9d6ab30-bc39-486e-a434-433118b69d8f [ 569.196797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.196797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.196797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.196952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.196994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.197159] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9d6ab30-bc39-486e-a434-433118b69d8f already deleted. [ 569.197234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d6ab30-bc39-486e-a434-433118b69d8f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.204679] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79c9067f-77f2-4089-9aa3-3160d9740d43 [ 569.204679] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.204679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.204679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.204679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.204679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.204679] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79c9067f-77f2-4089-9aa3-3160d9740d43 already deleted. [ 569.206063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79c9067f-77f2-4089-9aa3-3160d9740d43" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.361587] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9bcb9b90-65fe-47b1-a1f4-cede34388a5a None None] Enqueued Resource ID: 69464941-39ce-4b12-9db9-a80792191f26 with Priority: HIGHEST for action port [ 570.361587] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69464941-39ce-4b12-9db9-a80792191f26 with Priority: HIGHEST for action port [ 570.361587] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-69464941-39ce-4b12-9db9-a80792191f26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.364341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69464941-39ce-4b12-9db9-a80792191f26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.364341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69464941-39ce-4b12-9db9-a80792191f26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.364796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69464941-39ce-4b12-9db9-a80792191f26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.365016] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69464941-39ce-4b12-9db9-a80792191f26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.867870] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69464941-39ce-4b12-9db9-a80792191f26 [ 570.868579] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.869830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.869830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.869830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.869830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.869830] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69464941-39ce-4b12-9db9-a80792191f26 already deleted. [ 570.869830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69464941-39ce-4b12-9db9-a80792191f26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.974281] env[65231]: INFO networking_nsxv3.common.synchronization [None req-8265fa52-2d53-45af-b57c-f959afa0506c None None] Enqueued Resource ID: 9ce4db4e-1041-484e-8769-c54dcc9825d8 with Priority: HIGHEST for action port [ 570.974879] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce4db4e-1041-484e-8769-c54dcc9825d8 with Priority: HIGHEST for action port [ 570.975195] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ce4db4e-1041-484e-8769-c54dcc9825d8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.975325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ce4db4e-1041-484e-8769-c54dcc9825d8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.975405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ce4db4e-1041-484e-8769-c54dcc9825d8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.975630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ce4db4e-1041-484e-8769-c54dcc9825d8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.975731] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce4db4e-1041-484e-8769-c54dcc9825d8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.480918] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ce4db4e-1041-484e-8769-c54dcc9825d8 [ 571.481284] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.481408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.481408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.481696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.481744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.481824] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ce4db4e-1041-484e-8769-c54dcc9825d8 already deleted. [ 571.482110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ce4db4e-1041-484e-8769-c54dcc9825d8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.675633] env[65231]: INFO networking_nsxv3.common.synchronization [None req-aaceb5e7-2128-43a0-8c41-b789aed6ac75 None None] Enqueued Resource ID: 9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0 with Priority: HIGHEST for action port [ 571.676199] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0 with Priority: HIGHEST for action port [ 571.676507] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.676628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.676691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.677548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.677640] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.181943] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0 [ 572.181943] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.181943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.182265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.183834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.183834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.183834] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0 already deleted. [ 572.183834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dd5471f-a2df-4270-a9e3-11d1ff7dd3f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.569809] env[65231]: INFO networking_nsxv3.common.synchronization [None req-602445e3-185a-4f28-8571-198903e889f8 None None] Enqueued Resource ID: eed65460-4501-4538-a9ba-9caa2f74d13e with Priority: HIGHEST for action port [ 572.571291] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed65460-4501-4538-a9ba-9caa2f74d13e with Priority: HIGHEST for action port [ 572.571760] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed65460-4501-4538-a9ba-9caa2f74d13e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.572198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed65460-4501-4538-a9ba-9caa2f74d13e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.572198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed65460-4501-4538-a9ba-9caa2f74d13e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.573095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed65460-4501-4538-a9ba-9caa2f74d13e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.573095] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed65460-4501-4538-a9ba-9caa2f74d13e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.592173] env[65231]: INFO networking_nsxv3.common.synchronization [None req-8d95aab3-afd5-433e-bf2c-9e3e4b73142c tempest-ServersTestBootFromVolume-887912843 tempest-ServersTestBootFromVolume-887912843-project-member] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 572.592173] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 572.592173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.592173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.592173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.592376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.592376] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.057288] env[65231]: INFO networking_nsxv3.common.synchronization [None req-4b9fe0a4-736f-46e0-a065-87077a51dba2 tempest-ServersTestBootFromVolume-887912843 tempest-ServersTestBootFromVolume-887912843-project-member] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 573.057817] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 573.058118] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.058905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.074645] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eed65460-4501-4538-a9ba-9caa2f74d13e [ 573.074845] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.074977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.075074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.075270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.075365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.075460] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eed65460-4501-4538-a9ba-9caa2f74d13e already deleted. [ 573.075540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed65460-4501-4538-a9ba-9caa2f74d13e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.112170] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.112299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.112371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.112573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.112661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.112748] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 already deleted. [ 573.112824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.112970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.113126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.113205] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.472976] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2a4045a3-c981-4720-8c27-36432065a2ad None None] Enqueued Resource ID: 636e03bc-7391-4e0d-8173-02204cd3da34 with Priority: HIGHEST for action port [ 573.473669] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636e03bc-7391-4e0d-8173-02204cd3da34 with Priority: HIGHEST for action port [ 573.475154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-636e03bc-7391-4e0d-8173-02204cd3da34 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.475338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-636e03bc-7391-4e0d-8173-02204cd3da34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.475338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-636e03bc-7391-4e0d-8173-02204cd3da34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.475562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-636e03bc-7391-4e0d-8173-02204cd3da34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.475641] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('636e03bc-7391-4e0d-8173-02204cd3da34',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.634029] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.634029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.634029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.634449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.634449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.634513] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 already deleted. [ 573.634678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.943838] env[65231]: INFO networking_nsxv3.common.synchronization [None req-67925b8a-817a-4c0a-9c7e-a0582c41e806 None None] Enqueued Resource ID: 6064745a-fc91-41fc-aa23-b75cd5e20754 with Priority: HIGHEST for action port [ 573.943940] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6064745a-fc91-41fc-aa23-b75cd5e20754 with Priority: HIGHEST for action port [ 573.944165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6064745a-fc91-41fc-aa23-b75cd5e20754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.944309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6064745a-fc91-41fc-aa23-b75cd5e20754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.944375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6064745a-fc91-41fc-aa23-b75cd5e20754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.945120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6064745a-fc91-41fc-aa23-b75cd5e20754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.945120] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6064745a-fc91-41fc-aa23-b75cd5e20754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.978104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 636e03bc-7391-4e0d-8173-02204cd3da34 [ 573.978280] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.978420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.978490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.981026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.981026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.981026] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:636e03bc-7391-4e0d-8173-02204cd3da34 already deleted. [ 573.981026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-636e03bc-7391-4e0d-8173-02204cd3da34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.413100] env[65231]: INFO networking_nsxv3.common.synchronization [None req-6762a5a2-1c96-4fda-9bb0-8dc074165fcd None None] Enqueued Resource ID: c5059197-3c23-4553-b8f6-5f11bc489248 with Priority: HIGHEST for action port [ 574.414282] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5059197-3c23-4553-b8f6-5f11bc489248 with Priority: HIGHEST for action port [ 574.414786] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5059197-3c23-4553-b8f6-5f11bc489248 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.414979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5059197-3c23-4553-b8f6-5f11bc489248" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.415092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5059197-3c23-4553-b8f6-5f11bc489248" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.415392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5059197-3c23-4553-b8f6-5f11bc489248" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.415476] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5059197-3c23-4553-b8f6-5f11bc489248',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.453205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6064745a-fc91-41fc-aa23-b75cd5e20754 [ 574.453433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.454376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.454376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.454376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.454376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.454376] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6064745a-fc91-41fc-aa23-b75cd5e20754 already deleted. [ 574.454376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6064745a-fc91-41fc-aa23-b75cd5e20754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.920692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5059197-3c23-4553-b8f6-5f11bc489248 [ 574.920692] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.920692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.920692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.920692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.920692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.920692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5059197-3c23-4553-b8f6-5f11bc489248 already deleted. [ 574.920692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5059197-3c23-4553-b8f6-5f11bc489248" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.051182] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e5e01d65-faba-4ae0-941c-3bdc9d445dfb tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 575.053348] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 575.053910] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.054089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.054146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.054460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.054520] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.267371] env[65231]: INFO networking_nsxv3.common.synchronization [None req-14396295-b8fe-4743-91cd-a6be335f6f1f tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 575.267909] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 575.268236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.268337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.582084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.582084] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 already deleted. [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.582084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.582084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.807457] env[65231]: INFO networking_nsxv3.common.synchronization [req-e4a4a348-6418-45c8-80d5-f590c62f2a2d req-2aaf542e-e119-4c95-9afd-952481296b30 tempest-DeleteServersAdminTestJSON-1674141270 tempest-DeleteServersAdminTestJSON-1674141270-project-member] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 575.807683] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 575.808031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.808767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.808767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.808767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.808767] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.808767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.808767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.809104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.809104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.810209] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.103046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.103046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.103046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.103046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.103046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.103046] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 already deleted. [ 576.103046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.330575] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.330575] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.330575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 already deleted. [ 576.330575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.873021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.873021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.873021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.873021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.873021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.873668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.874850] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.875109] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.875293] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.875753] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 576.875901] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 576.876018] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 576.876148] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 576.876267] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 576.876340] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 576.876471] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 576.896973] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 576.897982] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 576.897982] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 576.897982] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.897982] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.897982] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.898255] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.898388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.898505] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59edc92-ca02-4bff-ac99-b4b3ad96c6eb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.090794] env[65231]: INFO networking_nsxv3.common.synchronization [None req-409ca143-ed55-46b2-b1ac-eddf66e15721 None None] Enqueued Resource ID: 0f231b7a-ec9e-42ef-814d-1a8e51aba05a with Priority: HIGHEST for action port [ 577.091081] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f231b7a-ec9e-42ef-814d-1a8e51aba05a with Priority: HIGHEST for action port [ 577.091654] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f231b7a-ec9e-42ef-814d-1a8e51aba05a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.091789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f231b7a-ec9e-42ef-814d-1a8e51aba05a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.091848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f231b7a-ec9e-42ef-814d-1a8e51aba05a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.092394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f231b7a-ec9e-42ef-814d-1a8e51aba05a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.092490] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f231b7a-ec9e-42ef-814d-1a8e51aba05a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.400934] env[65231]: INFO networking_nsxv3.common.synchronization [None req-cb8eed4e-f8a4-4bf7-844e-3e94ce45e5cb None None] Enqueued Resource ID: 7e2f464c-ac10-43da-a278-10e4c7bdaa3d with Priority: HIGHEST for action port [ 577.401428] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e2f464c-ac10-43da-a278-10e4c7bdaa3d with Priority: HIGHEST for action port [ 577.401716] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e2f464c-ac10-43da-a278-10e4c7bdaa3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.401835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e2f464c-ac10-43da-a278-10e4c7bdaa3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.401898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e2f464c-ac10-43da-a278-10e4c7bdaa3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.402858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e2f464c-ac10-43da-a278-10e4c7bdaa3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.402954] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e2f464c-ac10-43da-a278-10e4c7bdaa3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.403982] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.404206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.404283] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.404524] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.404726] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.404812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port e59edc92-ca02-4bff-ac99-b4b3ad96c6eb not found, creating... [ 577.405049] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.405206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.405384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.405583] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.405738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.408697] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.409038] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.409923] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.409923] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.410043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.411089] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: e59edc92-ca02-4bff-ac99-b4b3ad96c6eb is going to be created. [ 577.440020] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.440020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.440020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.440020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.440020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.440020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.594076] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f231b7a-ec9e-42ef-814d-1a8e51aba05a [ 577.594318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.594463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.594533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.594744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.594834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.594932] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f231b7a-ec9e-42ef-814d-1a8e51aba05a already deleted. [ 577.595010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f231b7a-ec9e-42ef-814d-1a8e51aba05a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.913682] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e2f464c-ac10-43da-a278-10e4c7bdaa3d [ 577.913920] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.914069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.914141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.914358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.914454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.914550] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e2f464c-ac10-43da-a278-10e4c7bdaa3d already deleted. [ 577.914752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e2f464c-ac10-43da-a278-10e4c7bdaa3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.965620] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ee4faf9d-68cd-4e45-aa04-65e7f11f6abd None None] Enqueued Resource ID: e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf with Priority: HIGHEST for action port [ 577.965913] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf with Priority: HIGHEST for action port [ 577.966521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.966719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.966719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.967067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.968045] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.259565] env[65231]: INFO networking_nsxv3.common.synchronization [req-e4a4a348-6418-45c8-80d5-f590c62f2a2d req-b668018f-f039-4977-b1b2-963c54bf05ad service nova] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_rules [ 578.259740] env[65231]: INFO networking_nsxv3.common.synchronization [req-e4a4a348-6418-45c8-80d5-f590c62f2a2d req-b668018f-f039-4977-b1b2-963c54bf05ad service nova] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 578.259907] env[65231]: INFO networking_nsxv3.common.synchronization [req-e4a4a348-6418-45c8-80d5-f590c62f2a2d req-b668018f-f039-4977-b1b2-963c54bf05ad service nova] Enqueued Resource ID: e59edc92-ca02-4bff-ac99-b4b3ad96c6eb with Priority: HIGHEST for action port [ 578.260555] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_rules [ 578.260667] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 578.260718] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59edc92-ca02-4bff-ac99-b4b3ad96c6eb with Priority: HIGHEST for action port [ 578.261073] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.261222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.261265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.262625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.262720] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.268467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.268467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.268467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.268467] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.272191] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.272191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.272191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.272191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.272191] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59edc92-ca02-4bff-ac99-b4b3ad96c6eb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.471812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf [ 578.472108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.472249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.472350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.472570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.472676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.472773] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf already deleted. [ 578.472906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2be52a5-9727-4f3e-b7bd-d64bfe3dfeaf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.503903] env[65231]: INFO networking_nsxv3.common.synchronization [None req-004c9d31-5872-4bf3-9cc1-1bcf986cfe89 None None] Enqueued Resource ID: 18c816b8-1f37-4bf5-9687-62725b462621 with Priority: HIGHEST for action port [ 578.503903] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c816b8-1f37-4bf5-9687-62725b462621 with Priority: HIGHEST for action port [ 578.504254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-18c816b8-1f37-4bf5-9687-62725b462621 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.504535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18c816b8-1f37-4bf5-9687-62725b462621" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.504706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18c816b8-1f37-4bf5-9687-62725b462621" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.505055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18c816b8-1f37-4bf5-9687-62725b462621" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.505306] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c816b8-1f37-4bf5-9687-62725b462621',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.774323] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.774468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.788966] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.793443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e59edc92-ca02-4bff-ac99-b4b3ad96c6eb with status ACTIVE [ 578.793781] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.795425] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.795425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.795837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.795837] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.795930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.796938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.797216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.798415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.798415] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e59edc92-ca02-4bff-ac99-b4b3ad96c6eb is going to be updated. [ 578.821906] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.821906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.822205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.822205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.822456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.822538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e59edc92-ca02-4bff-ac99-b4b3ad96c6eb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.008312] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18c816b8-1f37-4bf5-9687-62725b462621 [ 579.008426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.008500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.012554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.012554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.012554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.012554] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18c816b8-1f37-4bf5-9687-62725b462621 already deleted. [ 579.012554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18c816b8-1f37-4bf5-9687-62725b462621" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.294547] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.543047] env[65231]: INFO networking_nsxv3.common.synchronization [req-a16c596b-e91f-45d7-aec3-2c19cd7168cc req-b193f49e-ac59-4b29-befb-3ad1361a5599 tempest-ServerExternalEventsTest-808661776 tempest-ServerExternalEventsTest-808661776-project-member] Enqueued Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 579.543697] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 579.544022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.544185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.544244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.544479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.544893] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.544893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.544893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.545122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.545122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.545122] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.797807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.798027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.798156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.798443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.798540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.798643] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be created. [ 579.856158] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.856378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.856378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.856586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.857142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.867947] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: UNINITIALIZED for 2s [ 580.050028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.050028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.050028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.050498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.055020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.055020] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9389aaed-1ad6-48d4-af15-236c6a035cba already deleted. [ 580.055020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.082393] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.082601] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.083201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.083201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.083201] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.083410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.083506] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.083692] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.083765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.084336] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 580.084336] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 580.084492] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 580.084539] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 580.084643] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 580.084757] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 580.084889] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 580.104905] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 580.105299] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 580.106279] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 580.106279] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.106279] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-710be19f-d079-43d5-9901-1a61dc0bd7c1 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.106279] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.106492] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.107429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.107429] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710be19f-d079-43d5-9901-1a61dc0bd7c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.555525] env[65231]: INFO networking_nsxv3.common.synchronization [None req-fb5f877e-f634-4837-a5e6-c826373f4166 None None] Enqueued Resource ID: 48e697e7-9c7b-4d1c-9f5f-3110c3299f7e with Priority: HIGHEST for action port [ 580.555525] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e697e7-9c7b-4d1c-9f5f-3110c3299f7e with Priority: HIGHEST for action port [ 580.556342] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e697e7-9c7b-4d1c-9f5f-3110c3299f7e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.556342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e697e7-9c7b-4d1c-9f5f-3110c3299f7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.556548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e697e7-9c7b-4d1c-9f5f-3110c3299f7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.558597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e697e7-9c7b-4d1c-9f5f-3110c3299f7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.558597] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e697e7-9c7b-4d1c-9f5f-3110c3299f7e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.609846] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.610106] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.610106] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.610408] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.610573] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.610726] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 710be19f-d079-43d5-9901-1a61dc0bd7c1 not found, creating... [ 580.611056] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.611186] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.611266] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.611597] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.611730] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.612106] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.612440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.612440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.612596] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.612729] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.612936] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 710be19f-d079-43d5-9901-1a61dc0bd7c1 is going to be created. [ 580.635542] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.635790] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.635858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.636147] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.636381] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.636610] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.060275] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48e697e7-9c7b-4d1c-9f5f-3110c3299f7e [ 581.060625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.060833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.060933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.061261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.061408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.061561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48e697e7-9c7b-4d1c-9f5f-3110c3299f7e already deleted. [ 581.061698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e697e7-9c7b-4d1c-9f5f-3110c3299f7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.437681] env[65231]: INFO networking_nsxv3.common.synchronization [req-a16c596b-e91f-45d7-aec3-2c19cd7168cc req-ed0da558-4c8b-4eba-ac64-5f3338496dfa service nova] Enqueued Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_rules [ 581.437981] env[65231]: INFO networking_nsxv3.common.synchronization [req-a16c596b-e91f-45d7-aec3-2c19cd7168cc req-ed0da558-4c8b-4eba-ac64-5f3338496dfa service nova] Enqueued Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 581.438060] env[65231]: INFO networking_nsxv3.common.synchronization [req-a16c596b-e91f-45d7-aec3-2c19cd7168cc req-ed0da558-4c8b-4eba-ac64-5f3338496dfa service nova] Enqueued Resource ID: 710be19f-d079-43d5-9901-1a61dc0bd7c1 with Priority: HIGHEST for action port [ 581.438707] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_rules [ 581.439072] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 581.439072] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710be19f-d079-43d5-9901-1a61dc0bd7c1 with Priority: HIGHEST for action port [ 581.441050] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.441230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.441313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.441648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.441749] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.445054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.445202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.445273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.445465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.445588] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.445694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.445761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.445883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.445966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.446073] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.447056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-710be19f-d079-43d5-9901-1a61dc0bd7c1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.447465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.447534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.447684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.450022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710be19f-d079-43d5-9901-1a61dc0bd7c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.645541] env[65231]: INFO networking_nsxv3.common.synchronization [None req-87e97078-93fd-45de-ac6a-3d95dbf10020 tempest-VolumesAssistedSnapshotsTest-128861610 tempest-VolumesAssistedSnapshotsTest-128861610-project-member] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 581.646443] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 581.646443] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.646538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.646576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.646812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.646968] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.880600] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 581.880600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.880793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.881077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.881389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.881526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.881612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.881795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.881878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.881963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.882150] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.896565] env[65231]: INFO networking_nsxv3.common.synchronization [req-bf594198-541e-4211-97c1-3b1d360d858d req-da7f2316-48ac-4800-a9dc-e5ade9366432 tempest-ImagesNegativeTestJSON-250869385 tempest-ImagesNegativeTestJSON-250869385-project-member] Enqueued Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 581.898896] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 581.902279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.902279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.902453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.902647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.902836] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.902948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.902997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.903246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.903379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.903516] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.951291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.951291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.951291] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.952020] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 710be19f-d079-43d5-9901-1a61dc0bd7c1 with status ACTIVE [ 581.952020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.952020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.952020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.952298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.952298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.952414] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.953127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.953127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.953380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.953380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.953380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 710be19f-d079-43d5-9901-1a61dc0bd7c1 is going to be updated. [ 581.979017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.979017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.979017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.979017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.979354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.979354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710be19f-d079-43d5-9901-1a61dc0bd7c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.066882] env[65231]: INFO networking_nsxv3.common.synchronization [None req-195b5df5-726d-4dfd-ade2-0ad2dd652a1c tempest-VolumesAssistedSnapshotsTest-128861610 tempest-VolumesAssistedSnapshotsTest-128861610-project-member] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 582.067550] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 582.067891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.067996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.170116] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.170542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.170542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.170737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.170862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.170981] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cee33745-1169-4666-835e-545451997389 already deleted. [ 582.171173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.171358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.171547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.171685] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.311255] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.311719] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.311719] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.311915] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.312173] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.312327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.312471] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.312696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.312840] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.313405] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.313405] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.313500] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.313585] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.313747] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.314422] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.314422] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.334503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.334649] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 582.334767] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.334940] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-34" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.335859] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-a4110f91-72cd-4eb7-ad35-0a44f7b95883 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.335859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.335859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.335859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.336122] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4110f91-72cd-4eb7-ad35-0a44f7b95883',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.385073] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.385235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.385306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.385513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.385671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.385770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.385830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.386011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.386079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.386165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.386304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.386393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.386450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.386586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.386714] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.386799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.386856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.386983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.387064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.387507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.387507] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.407925] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.407925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.407925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.407925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.407925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.407925] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.407925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.408220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.408220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.408220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.408304] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb already deleted. [ 582.408360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.457946] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.702541] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.702898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.702898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.703469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.703588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.703689] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cee33745-1169-4666-835e-545451997389 already deleted. [ 582.703767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.789546] env[65231]: INFO networking_nsxv3.common.synchronization [None req-70a72592-1b09-493f-a4e2-34afaac39ee4 None None] Enqueued Resource ID: f2f8538c-5bb3-40cf-b77b-b086aea1b61c with Priority: HIGHEST for action port [ 582.790120] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8538c-5bb3-40cf-b77b-b086aea1b61c with Priority: HIGHEST for action port [ 582.790457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f8538c-5bb3-40cf-b77b-b086aea1b61c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.790575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f8538c-5bb3-40cf-b77b-b086aea1b61c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.790621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f8538c-5bb3-40cf-b77b-b086aea1b61c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.791344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f8538c-5bb3-40cf-b77b-b086aea1b61c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.791344] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f8538c-5bb3-40cf-b77b-b086aea1b61c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.838843] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.839469] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.839870] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.842019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port a4110f91-72cd-4eb7-ad35-0a44f7b95883 not found, creating... [ 582.842019] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.842019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.842769] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.843112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.843368] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.843736] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.844050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.845763] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: a4110f91-72cd-4eb7-ad35-0a44f7b95883 is going to be created. [ 582.865294] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.865501] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.865618] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.865878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.866128] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.866359] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.894356] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee4dd131-77b2-4914-aa5f-9f4b5de030a2: rpc.has_security_group_logging(os_id): False [ 582.933262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.933262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.933262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.933609] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.933609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.933609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.933745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.933745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.933998] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.933998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.934112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.934178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.934246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.934488] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be created. [ 582.968053] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.968053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.968053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.968053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.968053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.968053] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9389aaed-1ad6-48d4-af15-236c6a035cba is going to be created. [ 583.011626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.011626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.011626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.011626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.011626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.026528] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: UNINITIALIZED for 2s [ 583.085217] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.085371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.085441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.085672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.085887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.100540] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 583.121770] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d5539df1-4ef7-4a0f-8348-2b3baee9a83f None None] Enqueued Resource ID: 97dde02e-c9fa-458a-a335-6a7fc23fa0a1 with Priority: HIGHEST for action port [ 583.122335] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97dde02e-c9fa-458a-a335-6a7fc23fa0a1 with Priority: HIGHEST for action port [ 583.122651] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-97dde02e-c9fa-458a-a335-6a7fc23fa0a1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.122778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97dde02e-c9fa-458a-a335-6a7fc23fa0a1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.122833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97dde02e-c9fa-458a-a335-6a7fc23fa0a1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.124032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97dde02e-c9fa-458a-a335-6a7fc23fa0a1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.124113] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97dde02e-c9fa-458a-a335-6a7fc23fa0a1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.292598] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2f8538c-5bb3-40cf-b77b-b086aea1b61c [ 583.292828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.292968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.293168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.293303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.293416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.293836] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2f8538c-5bb3-40cf-b77b-b086aea1b61c already deleted. [ 583.293836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f8538c-5bb3-40cf-b77b-b086aea1b61c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [req-bf594198-541e-4211-97c1-3b1d360d858d req-3abe53d8-6be5-4774-ab05-45e7f4ab38bd service nova] Enqueued Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_rules [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [req-bf594198-541e-4211-97c1-3b1d360d858d req-3abe53d8-6be5-4774-ab05-45e7f4ab38bd service nova] Enqueued Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [req-bf594198-541e-4211-97c1-3b1d360d858d req-3abe53d8-6be5-4774-ab05-45e7f4ab38bd service nova] Enqueued Resource ID: a4110f91-72cd-4eb7-ad35-0a44f7b95883 with Priority: HIGHEST for action port [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_rules [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 583.597608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4110f91-72cd-4eb7-ad35-0a44f7b95883 with Priority: HIGHEST for action port [ 583.597608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.597608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.597608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.598637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.598637] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.600143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.600143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.600241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.600549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.600789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.600970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.602464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.602675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.602907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.603411] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.605216] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4110f91-72cd-4eb7-ad35-0a44f7b95883 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.605324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.605425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.605723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.608059] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4110f91-72cd-4eb7-ad35-0a44f7b95883',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.627960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97dde02e-c9fa-458a-a335-6a7fc23fa0a1 [ 583.627960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.627960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.627960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.627960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.627960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.627960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97dde02e-c9fa-458a-a335-6a7fc23fa0a1 already deleted. [ 583.627960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97dde02e-c9fa-458a-a335-6a7fc23fa0a1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.110529] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.110854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.111193] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.112597] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4110f91-72cd-4eb7-ad35-0a44f7b95883 with status ACTIVE [ 584.112907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.112907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.113084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.113192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.113283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.113459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.113560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.113633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.114020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.114118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.114342] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.114464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.114548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.114776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.114858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.115040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4110f91-72cd-4eb7-ad35-0a44f7b95883 is going to be updated. [ 584.138758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.138758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.138758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.138758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.138758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.138758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4110f91-72cd-4eb7-ad35-0a44f7b95883" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.393099] env[65231]: INFO networking_nsxv3.common.synchronization [req-05914718-3571-4ec8-8290-2e4b5ed6f3fc req-116f595d-84a8-4249-8b61-65977d92c102 tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 584.393099] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 584.393427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.393427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.393572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.393852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.394384] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.394384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.394384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.394546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.394667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.394983] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.613376] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.827132] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.827518] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.827718] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.828317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.828656] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.828935] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.829051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.829478] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.829557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.829799] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 584.830104] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 584.830104] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 584.830209] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 584.830461] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 584.830461] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 584.830652] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 584.854950] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 584.855370] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 584.855370] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 584.855528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.855782] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-476d9765-2481-473c-adf6-ed06e4008823 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.855978] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.856107] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.856445] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.856579] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476d9765-2481-473c-adf6-ed06e4008823',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.900295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.900295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.900295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.900822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.900822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.900822] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 already deleted. [ 584.900928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.049418] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: SUCCESS [ 585.049715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.049909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.050172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.050473] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.050654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.050654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.050889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.051061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.051122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.051226] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.114893] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 585.115650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.116870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.117109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.117270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.117429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.117523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.117621] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb is going to be created. [ 585.143261] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.143592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.143592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.143791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.143874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.155359] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: UNINITIALIZED for 2s [ 585.358694] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.358975] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.359121] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.359585] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.359737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.359890] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 476d9765-2481-473c-adf6-ed06e4008823 not found, creating... [ 585.360213] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.360547] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.360696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.360945] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.361124] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.361405] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.361639] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.362936] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.363260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.363415] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.363561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 476d9765-2481-473c-adf6-ed06e4008823 is going to be created. [ 585.386838] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.386838] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.386838] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.387192] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.387394] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.387633] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.554165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.554403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.554403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.554750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.554915] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.555078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.555177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.555307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.555397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.555484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.555665] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.555794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.555848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.556111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.556258] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.556357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.556415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.556581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.556681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.556772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.556863] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.060417] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9389aaed-1ad6-48d4-af15-236c6a035cba: rpc.has_security_group_logging(os_id): False [ 586.078716] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.078716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.078891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.079089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.079156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.079382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.079526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.079699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.079772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.079853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.080162] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.080242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.080242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.080535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.080535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.080754] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.080901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.080951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.081118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.081281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.081330] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9389aaed-1ad6-48d4-af15-236c6a035cba is going to be created. [ 586.144675] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.145089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.145089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.145258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.145511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.159247] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: IN_PROGRESS for 2s [ 586.217866] env[65231]: INFO networking_nsxv3.common.synchronization [req-05914718-3571-4ec8-8290-2e4b5ed6f3fc req-3bd6d56c-1626-4ad0-89ce-93e89d87a1e5 service nova] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_rules [ 586.217866] env[65231]: INFO networking_nsxv3.common.synchronization [req-05914718-3571-4ec8-8290-2e4b5ed6f3fc req-3bd6d56c-1626-4ad0-89ce-93e89d87a1e5 service nova] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 586.218165] env[65231]: INFO networking_nsxv3.common.synchronization [req-05914718-3571-4ec8-8290-2e4b5ed6f3fc req-3bd6d56c-1626-4ad0-89ce-93e89d87a1e5 service nova] Enqueued Resource ID: 476d9765-2481-473c-adf6-ed06e4008823 with Priority: HIGHEST for action port [ 586.218504] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_rules [ 586.218643] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 586.218793] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476d9765-2481-473c-adf6-ed06e4008823 with Priority: HIGHEST for action port [ 586.220314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.220314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.220314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.220314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.220314] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.221012] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.221952] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.221952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.222850] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.224616] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-476d9765-2481-473c-adf6-ed06e4008823 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.224616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.224616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.224982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.224982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476d9765-2481-473c-adf6-ed06e4008823',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.526486] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-d73e0f0a-1e50-4461-992d-be2bf732a6bd tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 586.527669] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 586.530753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.530753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.530753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.530753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.530753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.530753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.530753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.531041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.531041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.531106] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.727696] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.729193] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.729380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.729517] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 476d9765-2481-473c-adf6-ed06e4008823 with status ACTIVE [ 586.729719] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.729844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.729914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.730171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.730396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.730458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.730561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.730643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.730807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.730894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.731907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.732340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.732543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.733374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.733374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.733374] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 476d9765-2481-473c-adf6-ed06e4008823 is going to be updated. [ 586.768179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.768406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.768556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.768763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.768918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.769473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476d9765-2481-473c-adf6-ed06e4008823" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.998319] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.999050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.999050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.999274] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.999551] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.000089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.000089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.000089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.000215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.001045] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.001045] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.001045] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.001045] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.001045] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.001045] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.002070] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.023027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.023148] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.023209] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.023399] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.023771] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-443c2a6e-9c27-41bc-9174-764b92f28ff9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.023888] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.024045] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.024678] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.024793] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('443c2a6e-9c27-41bc-9174-764b92f28ff9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.033904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.034080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.034159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.034501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.034601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.035299] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.035418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.035498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.035665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.035824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.035952] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f already deleted. [ 587.036192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.167269] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: SUCCESS [ 587.167625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.167625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.168369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.168369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.168369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.168369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.168583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.168583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.168649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.168803] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.235772] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.530464] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.530464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 443c2a6e-9c27-41bc-9174-764b92f28ff9 not found, creating... [ 587.530464] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.530464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.531159] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.531159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.531159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.531159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.531159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.531725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 443c2a6e-9c27-41bc-9174-764b92f28ff9 is going to be created. [ 587.557122] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.557357] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.557480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.557759] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.557985] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.558218] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.671259] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.671437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.671477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.671836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.672103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.672232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.672232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.672522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.672522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.672613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.672777] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.672881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.672956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.673130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.673272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.673366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.673421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.673562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.673644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.673721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.673813] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.742311] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.742311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.742311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.742311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.742311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.742311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be created. [ 587.768968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.768968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.768968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.769246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.769246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.779394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: UNINITIALIZED for 2s [ 588.172364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: SUCCESS [ 588.172364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.176579] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb: rpc.has_security_group_logging(os_id): False [ 588.193474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.193682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.193682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.193902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.194012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.194211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.194317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.194374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.194511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.194620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.194758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.194853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.194901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.195055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.195126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.195316] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.195456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.195538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.195672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.195746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.195830] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb is going to be created. [ 588.254644] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-3128c5d2-6b91-4727-96fd-28e822dff893 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 588.255547] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-3128c5d2-6b91-4727-96fd-28e822dff893 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 588.255835] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-3128c5d2-6b91-4727-96fd-28e822dff893 service nova] Enqueued Resource ID: 443c2a6e-9c27-41bc-9174-764b92f28ff9 with Priority: HIGHEST for action port [ 588.256360] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 588.256505] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 588.256601] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 443c2a6e-9c27-41bc-9174-764b92f28ff9 with Priority: HIGHEST for action port [ 588.257117] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.257117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.257117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.257424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.257521] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.258423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.258542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.258679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.258775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.258973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.259059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.263646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.263836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.263923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.264049] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.264954] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-443c2a6e-9c27-41bc-9174-764b92f28ff9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.266674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.266674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.266674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.266674] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('443c2a6e-9c27-41bc-9174-764b92f28ff9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.267635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.267809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.267809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.267969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.268159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.280574] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: IN_PROGRESS for 2s [ 588.714995] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-e805ef9c-b8c8-448c-a755-a18e3bd7ea37 tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 588.715501] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 588.715791] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.715791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.770378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.770634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.770860] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 443c2a6e-9c27-41bc-9174-764b92f28ff9 with status ACTIVE [ 588.771241] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.771343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.771480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.771791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.771957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.772238] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.772409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.772500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.772839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.772909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.773620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.773889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.774074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.774353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.774539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.774699] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 443c2a6e-9c27-41bc-9174-764b92f28ff9 is going to be updated. [ 588.777035] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.809149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.809149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.809149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.809149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.809149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.809149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-443c2a6e-9c27-41bc-9174-764b92f28ff9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.086918] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.087141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.087346] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.087704] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.088020] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.088500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.088500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.088654] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.088764] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.088984] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.089107] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.089207] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.089387] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.089521] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.089773] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.089773] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.119497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.119699] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.119825] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.120010] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.120411] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.120693] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.120828] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.121188] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.121374] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.281484] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.623967] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.624246] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.624314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.624599] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.624763] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.624936] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 not found, creating... [ 589.625150] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.625372] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.625428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.625608] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.625726] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.625997] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.626175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.626314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.626450] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.626578] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.626708] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 is going to be created. [ 589.648666] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.648932] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.649094] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.649422] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.649689] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.649928] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.784015] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.784303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.784425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.784754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.784975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.785177] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be created. [ 589.791904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 589.792150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.792316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.792536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.792735] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.792853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.792920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.793102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.793185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.793271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.793362] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.815907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.816025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.816079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.816515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.816515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.830634] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: UNINITIALIZED for 2s [ 590.293556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: SUCCESS [ 590.293898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.298653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.298814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.298885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.299177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.299421] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.299503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.299567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.299729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.299814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.299898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.300059] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.300197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.300243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.300350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.300484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.300584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.300945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.300945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.300945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.300945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.301119] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.365553] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-202fcb46-7102-46dc-99f2-557a9c4772d4 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 590.365784] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-202fcb46-7102-46dc-99f2-557a9c4772d4 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 590.366044] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-202fcb46-7102-46dc-99f2-557a9c4772d4 service nova] Enqueued Resource ID: 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 with Priority: HIGHEST for action port [ 590.366773] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 590.367320] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 590.367552] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 with Priority: HIGHEST for action port [ 590.367987] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.368191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.368448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.368545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.368921] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.368921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.368921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.369353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.369509] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.803152] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0: rpc.has_security_group_logging(os_id): False [ 590.825128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.825340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.825394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.825788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.825964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.826208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.826354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.826452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.826572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.830206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.830598] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.830723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.830806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.831100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.831207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.831425] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.831522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.831582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.831727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.831847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.831882] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be created. [ 590.872191] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 with status ACTIVE [ 590.872191] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.872191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.872655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.872655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.872655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.872875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.872938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.873602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.873602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.873602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.873602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.873602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.873602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.874356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.874356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.874356] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466 is going to be updated. [ 590.901904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.902196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.902294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.902617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.902827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.903080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223b9b1d-2a2a-4c3a-bdde-13a5e7ff9466" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.925457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.925593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.925679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.925910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.926959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.940019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 591.171535] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-d3435d00-f8c0-4f65-9509-a3fae536e062 tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 591.171535] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 591.171535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.171535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.625384] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.625787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.625787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.625969] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.627775] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.627775] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.629091] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.629430] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.629616] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.629833] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.629943] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.630068] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.630172] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.630274] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.630379] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.630535] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.656187] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.656359] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.656401] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.656562] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-936" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.656965] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.657652] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.657833] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.658254] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.658441] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.844046] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.844046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.844046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.844046] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.160959] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.161167] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.161288] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.161624] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.161679] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.161825] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef not found, creating... [ 592.162187] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.162351] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.162456] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.162670] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.162801] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.163158] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.163309] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.163422] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.163622] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.163746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.163886] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef is going to be created. [ 592.191341] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.191558] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.191672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.191916] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.192196] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.192396] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.347235] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.475714] env[65231]: INFO networking_nsxv3.common.synchronization [None req-6152bc53-009f-47c9-8966-0258ad4c6dc0 None None] Enqueued Resource ID: b15eca32-79c6-406a-8461-df29fc5f1483 with Priority: HIGHEST for action port [ 592.475990] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15eca32-79c6-406a-8461-df29fc5f1483 with Priority: HIGHEST for action port [ 592.476644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15eca32-79c6-406a-8461-df29fc5f1483 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.476770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15eca32-79c6-406a-8461-df29fc5f1483" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.476916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15eca32-79c6-406a-8461-df29fc5f1483" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.477877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15eca32-79c6-406a-8461-df29fc5f1483" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.477917] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15eca32-79c6-406a-8461-df29fc5f1483',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.850641] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.955120] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 592.955588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.981785] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-03172b73-b6cf-417f-be8c-bef7c699d727 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 592.981785] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-03172b73-b6cf-417f-be8c-bef7c699d727 service nova] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 592.981785] env[65231]: INFO networking_nsxv3.common.synchronization [req-c8a7a414-977c-423c-b765-9a1f56e4416b req-03172b73-b6cf-417f-be8c-bef7c699d727 service nova] Enqueued Resource ID: 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef with Priority: HIGHEST for action port [ 592.983858] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_rules [ 592.984110] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 592.984565] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef with Priority: HIGHEST for action port [ 592.988693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b15eca32-79c6-406a-8461-df29fc5f1483 [ 592.988693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.988693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.988693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.988693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.988693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.988693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b15eca32-79c6-406a-8461-df29fc5f1483 already deleted. [ 592.988693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15eca32-79c6-406a-8461-df29fc5f1483" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.989178] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.989289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.989582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.989703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.990021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.990566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.990566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.990566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.990727] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.352174] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.352347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.352396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.352607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.352683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.352782] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 593.403199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.403199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.403199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.403199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.403199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.415910] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 593.497332] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef with status ACTIVE [ 593.501146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.501389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.501437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.501657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.501758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.502124] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.502124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.502124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.502430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.502430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.502576] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.502681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.502681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.502801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.502933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.502968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef is going to be updated. [ 593.528864] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.529103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.529203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.529548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.530125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.530125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dfa5a64-29d9-4f4f-9f33-6e028aabb2ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.587828] env[65231]: INFO networking_nsxv3.common.synchronization [req-7f1f01b2-6dc8-436d-bb39-d9908d1394a1 req-3bfb1117-c46b-4671-a156-012e35429242 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 594.587828] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 594.587828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.587828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.587828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.587828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.587828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.587828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.587828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.588470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.588470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.590515] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.673280] env[65231]: INFO networking_nsxv3.common.synchronization [None req-3d896c7d-1c37-4fba-98eb-ecfc39e8f9e9 None None] Enqueued Resource ID: 748baced-f923-4ca6-9e4e-a4db61c1c5fd with Priority: HIGHEST for action port [ 594.674898] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748baced-f923-4ca6-9e4e-a4db61c1c5fd with Priority: HIGHEST for action port [ 594.675263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-748baced-f923-4ca6-9e4e-a4db61c1c5fd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.675404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-748baced-f923-4ca6-9e4e-a4db61c1c5fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.675476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-748baced-f923-4ca6-9e4e-a4db61c1c5fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.675742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-748baced-f923-4ca6-9e4e-a4db61c1c5fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.675893] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('748baced-f923-4ca6-9e4e-a4db61c1c5fd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.092868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.093067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.093115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.093448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.093576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.093782] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.093878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.093938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.094124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.094223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.094283] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 already deleted. [ 595.094358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.180038] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 748baced-f923-4ca6-9e4e-a4db61c1c5fd [ 595.180790] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.180790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.180790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.180790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.181560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.181560] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:748baced-f923-4ca6-9e4e-a4db61c1c5fd already deleted. [ 595.181560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-748baced-f923-4ca6-9e4e-a4db61c1c5fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.291949] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.292168] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-730" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.292285] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-730" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.292581] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-730" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.292829] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.292979] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.293185] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.293307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.293441] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.293629] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.293734] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.293836] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.293937] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.294046] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.294146] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.294277] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.313253] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.313415] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.313551] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.313725] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-730" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.314039] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-52ca75c9-0011-476a-9171-7109905cd39b taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.314210] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.314311] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.314612] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.314744] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52ca75c9-0011-476a-9171-7109905cd39b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.426544] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 595.426771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.427581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.427581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.428064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.428064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.428064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.428064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.428283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.428283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.428355] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.429255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.429349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.429495] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.429598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.429660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.430067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.430067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.430067] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.817845] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.818169] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.818255] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.818594] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.818759] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.819057] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 52ca75c9-0011-476a-9171-7109905cd39b not found, creating... [ 595.819318] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.819504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.819633] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.819865] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.819992] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.820470] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.820470] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.820621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.820811] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.820890] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.821106] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 52ca75c9-0011-476a-9171-7109905cd39b is going to be created. [ 595.843258] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.843507] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.843708] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.844055] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.844368] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.844618] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.932494] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.933276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.933423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.434230] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.558416] env[65231]: INFO networking_nsxv3.common.synchronization [req-7f1f01b2-6dc8-436d-bb39-d9908d1394a1 req-e5d0655e-16d3-43c3-8272-98e56d051208 service nova] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 596.558416] env[65231]: INFO networking_nsxv3.common.synchronization [req-7f1f01b2-6dc8-436d-bb39-d9908d1394a1 req-e5d0655e-16d3-43c3-8272-98e56d051208 service nova] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 596.558416] env[65231]: INFO networking_nsxv3.common.synchronization [req-7f1f01b2-6dc8-436d-bb39-d9908d1394a1 req-e5d0655e-16d3-43c3-8272-98e56d051208 service nova] Enqueued Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 596.558986] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 596.559078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 596.559169] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 596.559492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.559667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.559667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.559837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.559916] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.560837] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.560953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.561214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.561214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.561338] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.561414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.561474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.561619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.561705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.561825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.562757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-52ca75c9-0011-476a-9171-7109905cd39b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.562866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.562932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.563098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.563173] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52ca75c9-0011-476a-9171-7109905cd39b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.937055] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.937672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.937672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.937672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.937846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.937846] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 596.969568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.969832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.969962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.970289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.970524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.982183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 597.034953] env[65231]: INFO networking_nsxv3.common.synchronization [req-b91c515a-d794-487d-8bac-20f3850314aa req-83ab0bac-3976-48f6-af79-80089f36bc7e tempest-ServerTagsTestJSON-86635438 tempest-ServerTagsTestJSON-86635438-project-member] Enqueued Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 597.035888] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 597.036363] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.036500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.036602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.036951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.037192] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.037375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.037461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.037711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.037844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.037982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.064570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.064842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.064968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52ca75c9-0011-476a-9171-7109905cd39b with status ACTIVE [ 597.065200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.065348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.065441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.065748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.065892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.066113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.066250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.066358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.066531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.066862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.067015] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.067485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.067485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.067727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.067875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.067999] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52ca75c9-0011-476a-9171-7109905cd39b is going to be updated. [ 597.069543] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.091875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.092463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.092463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.092463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.092463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.092740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.447295] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-386 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.447295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-386" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.447295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-386" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.447295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-386" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.448178] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.448576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.448845] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.449301] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.449636] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.450394] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.450702] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.450965] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.451253] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.451671] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.452052] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.452579] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.475686] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.475686] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.475686] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.475686] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-386" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.475686] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-a883703b-38cd-497a-bcfd-a9e8be2484b2 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.476402] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.476402] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.476402] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.476838] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a883703b-38cd-497a-bcfd-a9e8be2484b2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.541748] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.541748] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.541748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.542255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.542255] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb already deleted. [ 597.542255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.563494] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b059fa3d-511e-4ad3-9af8-7b66192c61e5 None None] Enqueued Resource ID: 95848732-f4bb-4181-89c0-b0311dc7850d with Priority: HIGHEST for action port [ 597.564045] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95848732-f4bb-4181-89c0-b0311dc7850d with Priority: HIGHEST for action port [ 597.564307] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-95848732-f4bb-4181-89c0-b0311dc7850d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.564399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95848732-f4bb-4181-89c0-b0311dc7850d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.564468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95848732-f4bb-4181-89c0-b0311dc7850d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.564729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95848732-f4bb-4181-89c0-b0311dc7850d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.564808] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95848732-f4bb-4181-89c0-b0311dc7850d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.571875] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.980283] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.980696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.980696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.980895] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.981059] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.981216] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port a883703b-38cd-497a-bcfd-a9e8be2484b2 not found, creating... [ 597.981469] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.981621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.981753] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.981934] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.982077] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.982362] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.982510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.982622] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.982821] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.982951] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.983812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: a883703b-38cd-497a-bcfd-a9e8be2484b2 is going to be created. [ 598.022729] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.022982] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.023196] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.023551] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.024080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.024634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.068789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95848732-f4bb-4181-89c0-b0311dc7850d [ 598.069083] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.069260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.069335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.069652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.069789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.069925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95848732-f4bb-4181-89c0-b0311dc7850d already deleted. [ 598.070042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95848732-f4bb-4181-89c0-b0311dc7850d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.078020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.078190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.078262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.078786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.078884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.078983] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be created. [ 598.108108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.108108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.108404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.108404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.108662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.122068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: UNINITIALIZED for 2s [ 598.793266] env[65231]: INFO networking_nsxv3.common.synchronization [req-b91c515a-d794-487d-8bac-20f3850314aa req-3325de0b-3407-4d37-8a77-74236a10a57d service nova] Enqueued Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_rules [ 598.793465] env[65231]: INFO networking_nsxv3.common.synchronization [req-b91c515a-d794-487d-8bac-20f3850314aa req-3325de0b-3407-4d37-8a77-74236a10a57d service nova] Enqueued Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 598.793675] env[65231]: INFO networking_nsxv3.common.synchronization [req-b91c515a-d794-487d-8bac-20f3850314aa req-3325de0b-3407-4d37-8a77-74236a10a57d service nova] Enqueued Resource ID: a883703b-38cd-497a-bcfd-a9e8be2484b2 with Priority: HIGHEST for action port [ 598.794533] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_rules [ 598.794631] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 598.794732] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a883703b-38cd-497a-bcfd-a9e8be2484b2 with Priority: HIGHEST for action port [ 598.795596] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.795732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.795732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.796189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.796189] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.798661] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.798661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.798661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.798661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.798661] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.799063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.799063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.799063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.799273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.799273] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.802692] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a883703b-38cd-497a-bcfd-a9e8be2484b2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.802692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.802692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.802692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.802692] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a883703b-38cd-497a-bcfd-a9e8be2484b2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.009217] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 599.009663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.009799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.010090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.010330] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.010471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.010567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.010767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.010860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.010959] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.301388] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.311700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.311700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a883703b-38cd-497a-bcfd-a9e8be2484b2 with status ACTIVE [ 599.311700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.311700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.311700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.312498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.316371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.316371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.316371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.316371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.316371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a883703b-38cd-497a-bcfd-a9e8be2484b2 is going to be updated. [ 599.345075] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.345237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.345303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.345652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.345652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.345796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a883703b-38cd-497a-bcfd-a9e8be2484b2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.519655] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.519655] env[65231]: INFO networking_nsxv3.common.synchronization [None req-abe087e8-c351-4968-9d75-c6822daa497e None None] Enqueued Resource ID: 4fcdcbd3-12da-4f0d-8d0c-3159bd07e748 with Priority: HIGHEST for action port [ 599.519655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcdcbd3-12da-4f0d-8d0c-3159bd07e748 with Priority: HIGHEST for action port [ 599.519655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fcdcbd3-12da-4f0d-8d0c-3159bd07e748 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.519655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fcdcbd3-12da-4f0d-8d0c-3159bd07e748" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.519655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fcdcbd3-12da-4f0d-8d0c-3159bd07e748" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.520532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fcdcbd3-12da-4f0d-8d0c-3159bd07e748" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.520532] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fcdcbd3-12da-4f0d-8d0c-3159bd07e748',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.637928] env[65231]: INFO networking_nsxv3.common.synchronization [req-98e32443-67d3-437e-8731-e9f4817c6ee7 req-8cdca762-c337-4f40-b674-be53527faacf tempest-VolumesAssistedSnapshotsTest-128861610 tempest-VolumesAssistedSnapshotsTest-128861610-project-member] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 599.640199] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 599.640199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.640199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.640199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.642290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.642290] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.642290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.642290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.642290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.642290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.645488] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.808166] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.022986] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.024733] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fcdcbd3-12da-4f0d-8d0c-3159bd07e748 [ 600.024733] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.025127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.025127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.025754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.025754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.025754] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fcdcbd3-12da-4f0d-8d0c-3159bd07e748 already deleted. [ 600.025754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fcdcbd3-12da-4f0d-8d0c-3159bd07e748" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.098034] env[65231]: INFO networking_nsxv3.common.synchronization [None req-55408149-ff4f-440e-b005-75e9d2155c28 None None] Enqueued Resource ID: e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28 with Priority: HIGHEST for action port [ 600.098510] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28 with Priority: HIGHEST for action port [ 600.098838] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.098961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.100039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.100359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.100460] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.134402] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 600.134735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.135223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.136800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.136800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.136800] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.147455] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.147694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.147772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.147988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.148094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.148295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.148425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.148489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.148643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.148842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.148842] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cee33745-1169-4666-835e-545451997389 already deleted. [ 600.148965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.312615] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.312615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.312615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.312872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.312904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.314119] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb is going to be created. [ 600.342840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.343102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.343102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.343312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.343528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.357141] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: UNINITIALIZED for 2s [ 600.395111] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.395307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-162" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.395429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-162" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.395761] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-162" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.396201] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.396427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.396582] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.396847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.396988] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.397299] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.397554] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.397554] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.397814] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.397891] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.398024] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.398215] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.418556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.418556] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.418738] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.418954] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-162" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.419289] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-f652c066-a02b-4669-90e4-0c512944bc6e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.419460] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.419871] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.420789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.420789] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f652c066-a02b-4669-90e4-0c512944bc6e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.528616] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.528767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.529230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.529230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.529230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.529379] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 600.559998] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.560246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.560337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.560656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.561047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.570412] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 600.603291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28 [ 600.603472] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.603609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.603687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.603884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.603973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.604077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28 already deleted. [ 600.604162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e75a6d34-9df6-4fc0-9f3f-a6eb50e0af28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.638403] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.923854] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.924604] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.924787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.925374] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.925641] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.925885] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port f652c066-a02b-4669-90e4-0c512944bc6e not found, creating... [ 600.926260] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.926549] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.926717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.927144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.928084] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.928084] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.928084] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.928272] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.928859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.928859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.929032] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: f652c066-a02b-4669-90e4-0c512944bc6e is going to be created. [ 600.956156] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.956632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.956833] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.957175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.957825] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.958268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.142240] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdb04723-8209-4d79-9e38-c5a195883f28: rpc.has_security_group_logging(os_id): False [ 601.165011] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.165796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.165796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.165796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.165796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.166046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.166149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.166209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.166395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.166514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.166565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be created. [ 601.258230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.258430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.258430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.258656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.258877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.270846] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 601.533153] env[65231]: INFO networking_nsxv3.common.synchronization [None req-57417059-bb1c-4da9-a1f5-51b10bd674bd None None] Enqueued Resource ID: 3f3135da-f5d4-4369-ae69-3a4e29675831 with Priority: HIGHEST for action port [ 601.533978] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f3135da-f5d4-4369-ae69-3a4e29675831 with Priority: HIGHEST for action port [ 601.534423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f3135da-f5d4-4369-ae69-3a4e29675831 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.534630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f3135da-f5d4-4369-ae69-3a4e29675831" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.534943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f3135da-f5d4-4369-ae69-3a4e29675831" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.535165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f3135da-f5d4-4369-ae69-3a4e29675831" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.535225] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f3135da-f5d4-4369-ae69-3a4e29675831',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [req-98e32443-67d3-437e-8731-e9f4817c6ee7 req-bcfc1c51-9d9a-4580-970c-efd949f19064 service nova] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [req-98e32443-67d3-437e-8731-e9f4817c6ee7 req-bcfc1c51-9d9a-4580-970c-efd949f19064 service nova] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [req-98e32443-67d3-437e-8731-e9f4817c6ee7 req-bcfc1c51-9d9a-4580-970c-efd949f19064 service nova] Enqueued Resource ID: f652c066-a02b-4669-90e4-0c512944bc6e with Priority: HIGHEST for action port [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_rules [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 601.686862] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f652c066-a02b-4669-90e4-0c512944bc6e with Priority: HIGHEST for action port [ 601.686862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.686862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.686862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.687219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.687219] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.688840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.688957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.689051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.689349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.689523] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.689838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.689838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.689838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.690017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.690070] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.691173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f652c066-a02b-4669-90e4-0c512944bc6e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.691306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.691377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.691730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.691730] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f652c066-a02b-4669-90e4-0c512944bc6e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.038077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f3135da-f5d4-4369-ae69-3a4e29675831 [ 602.038565] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.039562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.039562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.039562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.039562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.039562] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f3135da-f5d4-4369-ae69-3a4e29675831 already deleted. [ 602.039562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f3135da-f5d4-4369-ae69-3a4e29675831" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.102089] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e85392c-eb38-49dc-91d8-bb69360a354e req-604ab016-b9b1-4005-b11b-8a5c9c4e5b37 tempest-ServersAdminNegativeTestJSON-1762838769 tempest-ServersAdminNegativeTestJSON-1762838769-project-member] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 602.102712] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 602.103137] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.103530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.103530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.103905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.104520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.104520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.104520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.104520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.104736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.104736] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.189681] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.190114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.196580] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.197351] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f652c066-a02b-4669-90e4-0c512944bc6e with status ACTIVE [ 602.197554] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.197679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.197747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.197953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.198071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.198253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.198364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.198401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.198555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.198633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.198808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.198899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.198964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.199133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.199210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.199291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f652c066-a02b-4669-90e4-0c512944bc6e is going to be updated. [ 602.229388] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.229388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.229557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.231155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.231386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.231570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f652c066-a02b-4669-90e4-0c512944bc6e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.375520] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: SUCCESS [ 602.375520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.375520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.375520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.381300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.381300] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.551655] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.551894] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.552061] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.552344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.552659] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.552841] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.552968] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.553470] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.553619] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.553850] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.554012] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.554122] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.554204] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.554366] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.554473] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.554608] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.575864] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.580495] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.580838] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.581080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.581697] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.581697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.582084] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.582148] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.582264] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.586422] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 602.586614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.586780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.586975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.588293] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.588293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.588293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.588293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.588293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.588293] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.608806] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.609746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.609746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.609746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.609746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.609999] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.609999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.610112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.610214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.610292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.610376] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 already deleted. [ 602.610459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.703307] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.883886] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.883886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.883886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.883886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.883886] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.884648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.884648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.884648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.884648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.884648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.884839] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.884882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.884948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.885099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.885277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.885379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.885443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.885626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.885717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.885825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.885919] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.086990] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.087480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.087677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.088047] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.088225] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.088556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 not found, creating... [ 603.088820] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.088953] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.089127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.089563] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.089640] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.090049] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.090258] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.090406] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.090678] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.090819] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.090962] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 is going to be created. [ 603.092649] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.130755] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.131057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.131191] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.131516] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.131776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.132028] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.204876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.205360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.205360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.205360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.205486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.205519] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cee33745-1169-4666-835e-545451997389 is going to be created. [ 603.232720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.232909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.232960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.235763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.235763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.244368] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cee33745-1169-4666-835e-545451997389 in Status: UNINITIALIZED for 2s [ 603.297679] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 603.297921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.388740] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fbc0c08-a13f-4d85-8260-308f219683bb: rpc.has_security_group_logging(os_id): False [ 603.417636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.417769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.417769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.417952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.418061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.418270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.418376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.418441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.418593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.418671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.418847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.418957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.419049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.419160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.419234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.419407] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.419490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.419616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.419765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.419839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.419933] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb is going to be created. [ 603.500836] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.500836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.500836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.501169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.501205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.513207] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: IN_PROGRESS for 2s [ 603.596150] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.838615] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e85392c-eb38-49dc-91d8-bb69360a354e req-7f132969-b663-478e-b2e9-b31bcae932d6 service nova] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_rules [ 603.838814] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e85392c-eb38-49dc-91d8-bb69360a354e req-7f132969-b663-478e-b2e9-b31bcae932d6 service nova] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 603.838931] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e85392c-eb38-49dc-91d8-bb69360a354e req-7f132969-b663-478e-b2e9-b31bcae932d6 service nova] Enqueued Resource ID: 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 with Priority: HIGHEST for action port [ 603.839608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_rules [ 603.839790] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 603.839940] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 with Priority: HIGHEST for action port [ 603.841198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.841375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.841413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.841653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.841733] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.843858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.843858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.843858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.843858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.845428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.845428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.845624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.845624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.845733] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.100205] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.100453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.100453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.100891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.100891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.101075] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 604.142556] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.142556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.142556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.142556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.142943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.154460] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 604.348115] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.348115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.348983] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.357216] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 with status ACTIVE [ 604.357510] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.357652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.357755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.358009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.358110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.358309] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.358415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.358481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.358632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.358725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.359245] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.359245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.359245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.359401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.359401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.359458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37 is going to be updated. [ 604.384850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.385023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.385120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.385457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.385457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.385612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f8eb37e-bbe2-4c0b-a3f3-b2227c4e1f37" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.854548] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.255082] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cee33745-1169-4666-835e-545451997389 in Status: SUCCESS [ 605.255320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.255483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.255704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.255895] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.256025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.256083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.256230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.256310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.256391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.256482] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.359257] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.359530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.359530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.359866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.360033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.360146] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be created. [ 605.366546] env[65231]: INFO networking_nsxv3.common.synchronization [req-a0798b0d-77e6-42d3-ba73-41924bc16096 req-fa21e29b-159e-4b37-b39f-eb18309e4d7b tempest-DeleteServersAdminTestJSON-275480981 tempest-DeleteServersAdminTestJSON-275480981-project-admin] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 605.366944] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 605.367759] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.367894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.367965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.368174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.368332] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.368433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.368491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.368643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.368732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.368901] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.390863] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.391011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.391080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.395020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.395020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.404246] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: UNINITIALIZED for 2s [ 605.528311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: SUCCESS [ 605.528311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.759078] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.871101] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.871288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.871394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.871571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.871967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.872257] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.872373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.872626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.872708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.872793] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be updated. [ 605.904012] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.904012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.904012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.904012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.904273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.917354] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 606.085562] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f5ccdc2e-19a1-4c9c-9e62-e2ba34b04b9b None None] Enqueued Resource ID: cd9d86d2-204f-4151-80ee-d3f5dfd2f19e with Priority: HIGHEST for action port [ 606.085849] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd9d86d2-204f-4151-80ee-d3f5dfd2f19e with Priority: HIGHEST for action port [ 606.086647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd9d86d2-204f-4151-80ee-d3f5dfd2f19e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.086815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd9d86d2-204f-4151-80ee-d3f5dfd2f19e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.086923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd9d86d2-204f-4151-80ee-d3f5dfd2f19e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.087206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd9d86d2-204f-4151-80ee-d3f5dfd2f19e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.087319] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd9d86d2-204f-4151-80ee-d3f5dfd2f19e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.166441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 606.166441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.166653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.166891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.167124] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.167236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.167302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.167480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.167587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.167699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.167843] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.167940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.168417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.168417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.168417] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.168563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.168563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.168655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.168735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.168814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.168897] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.263791] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cee33745-1169-4666-835e-545451997389: rpc.has_security_group_logging(os_id): False [ 606.287025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.287025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.287025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.288621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.289028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.289028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cee33745-1169-4666-835e-545451997389 is going to be created. [ 606.362794] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.363200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.363200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.363421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.363680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.378543] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cee33745-1169-4666-835e-545451997389 in Status: IN_PROGRESS for 2s [ 606.589593] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd9d86d2-204f-4151-80ee-d3f5dfd2f19e [ 606.590386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.590561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.590673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.590922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.591031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.591155] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd9d86d2-204f-4151-80ee-d3f5dfd2f19e already deleted. [ 606.591252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd9d86d2-204f-4151-80ee-d3f5dfd2f19e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.672401] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 070cab8d-4383-4e42-847f-e29c9f10471f: rpc.has_security_group_logging(os_id): False [ 606.716416] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.716659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.716799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.716988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.719532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.719532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.719532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.719532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.721387] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be created. [ 606.838518] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.838706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.838773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.840210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.840210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.851414] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 607.415622] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 607.415622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.415622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.415622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.415967] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.415967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.415967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.416944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.416944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.416944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.416944] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.921659] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.922154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.922636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.922941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.924065] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.924222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.924357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.924730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.925732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.925732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.925732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.925732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.925908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.926745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.927314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.927482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.927576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.927982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.928149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.928528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.929254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.941798] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 607.942012] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 deletion is rescheduled due to dependency. [ 607.942167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.000397] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9a763234-91c7-43e9-a815-60c2d2dd8553 tempest-ServersV294TestFqdnHostnames-472328194 tempest-ServersV294TestFqdnHostnames-472328194-project-member] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 608.000983] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 608.001319] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.001442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.001511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.001947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.001947] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.183347] env[65231]: INFO networking_nsxv3.common.synchronization [req-7c021929-4d83-46a5-b0d6-b4622f3a6462 req-74874786-53f6-47d6-9d0c-a0a3518e7de6 tempest-ServersTestBootFromVolume-887912843 tempest-ServersTestBootFromVolume-887912843-project-member] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 608.183859] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 608.184023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.184561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.185076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.188139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.188139] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.188139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.188139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.188139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.188139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.188139] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.393989] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cee33745-1169-4666-835e-545451997389 in Status: SUCCESS [ 608.394260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.431810] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da07af9e-2db7-465e-9508-0c4801123c21: rpc.has_security_group_logging(os_id): False [ 608.452335] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.452581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.452692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.453033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.453225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.454223] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.454848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.454848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.454848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.454848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.455064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.455208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.456910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.457066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.457163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.457357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.457458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.457514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.457692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.457759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.457842] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be created. [ 608.528601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.528601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.528601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.528601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.528601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.528601] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b already deleted. [ 608.528601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.541591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.541591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.541591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.541591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.541591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.560147] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 608.568135] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9c489c46-ecb0-4936-84a2-e4192394515c None None] Enqueued Resource ID: 8144af52-36af-4943-bdef-16059dc0d988 with Priority: HIGHEST for action port [ 608.569357] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8144af52-36af-4943-bdef-16059dc0d988 with Priority: HIGHEST for action port [ 608.573203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8144af52-36af-4943-bdef-16059dc0d988 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.573203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8144af52-36af-4943-bdef-16059dc0d988" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.573203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8144af52-36af-4943-bdef-16059dc0d988" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.573203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8144af52-36af-4943-bdef-16059dc0d988" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.573203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8144af52-36af-4943-bdef-16059dc0d988',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.692935] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.693189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.693328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.693586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.693727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.693997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.694167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.694260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.694476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.694588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.694709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 already deleted. [ 608.694828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.867644] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 608.869742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.869742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.869742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.869742] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.081311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8144af52-36af-4943-bdef-16059dc0d988 [ 609.081774] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.081988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.082111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.082574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.082732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.082860] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8144af52-36af-4943-bdef-16059dc0d988 already deleted. [ 609.082990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8144af52-36af-4943-bdef-16059dc0d988" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.376203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.376203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.376203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.376203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.407733] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b5d14881-4e21-4e67-a37d-09d2d388b2da tempest-ServersV294TestFqdnHostnames-472328194 tempest-ServersV294TestFqdnHostnames-472328194-project-member] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 609.408666] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 609.409151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.410465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.410465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.410465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.410465] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.846815] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.847473] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-82" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.847473] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-82" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.847473] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-82" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.847757] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.847942] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.848801] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.848801] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.848801] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.849083] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.849272] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.849409] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.849547] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.849707] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.849864] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.849972] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.874485] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b44ab120-57a1-4fad-9301-2c8a081abc5b None None] Enqueued Resource ID: 29e2f776-2205-4c7d-8796-9717047254b7 with Priority: HIGHEST for action port [ 609.875973] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.875973] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.875973] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.875973] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-82" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.876947] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-646391ba-f714-45e4-91fe-72a8b49e3159 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.877158] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.877279] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.877648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.877729] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('646391ba-f714-45e4-91fe-72a8b49e3159',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.879155] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e2f776-2205-4c7d-8796-9717047254b7 with Priority: HIGHEST for action port [ 609.880027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e2f776-2205-4c7d-8796-9717047254b7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.880027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e2f776-2205-4c7d-8796-9717047254b7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.880193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e2f776-2205-4c7d-8796-9717047254b7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.880536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e2f776-2205-4c7d-8796-9717047254b7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.880536] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e2f776-2205-4c7d-8796-9717047254b7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.881339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.881339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.881339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.881519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.882098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.882098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.882098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.882098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.882098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.883135] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.883135] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.883135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.883552] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.934400] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.934777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.934910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.935428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.935537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.935770] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b already deleted. [ 609.935887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.381204] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.381556] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.381556] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.381976] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.382187] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.382387] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 646391ba-f714-45e4-91fe-72a8b49e3159 not found, creating... [ 610.382743] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.382967] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.383147] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.383539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.383688] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.383931] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.384181] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.384346] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.384598] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.384734] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.384951] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 646391ba-f714-45e4-91fe-72a8b49e3159 is going to be created. [ 610.386165] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29e2f776-2205-4c7d-8796-9717047254b7 [ 610.386348] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.386484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.386625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.386811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.386896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.386993] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29e2f776-2205-4c7d-8796-9717047254b7 already deleted. [ 610.387314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e2f776-2205-4c7d-8796-9717047254b7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.387674] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 070cab8d-4383-4e42-847f-e29c9f10471f: rpc.has_security_group_logging(os_id): False [ 610.413341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.413341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.413341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.414406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.414406] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.414406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.414406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.414841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.414841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.415130] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.415352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.415471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.415694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.415894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.416074] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 610.419413] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.419912] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.420139] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.420677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.421797] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.421797] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.446618] env[65231]: INFO networking_nsxv3.common.synchronization [None req-3f330462-d59b-4907-8467-7bfc343dc3fb None None] Enqueued Resource ID: ecdd8231-16c3-481a-86b1-30541633fb27 with Priority: HIGHEST for action port [ 610.446618] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdd8231-16c3-481a-86b1-30541633fb27 with Priority: HIGHEST for action port [ 610.446850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecdd8231-16c3-481a-86b1-30541633fb27 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.446960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecdd8231-16c3-481a-86b1-30541633fb27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.447092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecdd8231-16c3-481a-86b1-30541633fb27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.447355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecdd8231-16c3-481a-86b1-30541633fb27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.447457] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecdd8231-16c3-481a-86b1-30541633fb27',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.556294] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.556582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.556686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.556842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.557096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.578174] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 610.578418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.579496] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 610.951579] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecdd8231-16c3-481a-86b1-30541633fb27 [ 610.952141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.952141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.952141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.952336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.952514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.952514] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecdd8231-16c3-481a-86b1-30541633fb27 already deleted. [ 610.952713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecdd8231-16c3-481a-86b1-30541633fb27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.201784] env[65231]: INFO networking_nsxv3.common.synchronization [req-7c021929-4d83-46a5-b0d6-b4622f3a6462 req-71472796-611f-4dc1-9508-c6e16402b87e service nova] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 611.202035] env[65231]: INFO networking_nsxv3.common.synchronization [req-7c021929-4d83-46a5-b0d6-b4622f3a6462 req-71472796-611f-4dc1-9508-c6e16402b87e service nova] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 611.202281] env[65231]: INFO networking_nsxv3.common.synchronization [req-7c021929-4d83-46a5-b0d6-b4622f3a6462 req-71472796-611f-4dc1-9508-c6e16402b87e service nova] Enqueued Resource ID: 646391ba-f714-45e4-91fe-72a8b49e3159 with Priority: HIGHEST for action port [ 611.203054] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_rules [ 611.203467] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 611.203920] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646391ba-f714-45e4-91fe-72a8b49e3159 with Priority: HIGHEST for action port [ 611.203920] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.204191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.207017] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.207017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.207017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.207017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.207017] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.207542] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-646391ba-f714-45e4-91fe-72a8b49e3159 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.207542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.207542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.207542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.207752] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('646391ba-f714-45e4-91fe-72a8b49e3159',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.711073] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 646391ba-f714-45e4-91fe-72a8b49e3159 with status ACTIVE [ 611.711424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.711549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.711549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.712054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.712054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.712054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.712285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.712285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.712392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.712439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.712588] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.712670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.712990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.712990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.713096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.713259] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 646391ba-f714-45e4-91fe-72a8b49e3159 is going to be updated. [ 611.714491] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.714631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.714708] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.740981] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.742332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.742466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.742667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.742838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.743184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-646391ba-f714-45e4-91fe-72a8b49e3159" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.120985] env[65231]: INFO networking_nsxv3.common.synchronization [req-f007437c-fd91-49df-b5a1-aca54dcef257 req-cebbe393-6fa2-40ef-bf41-fd698e2dcd5c tempest-ServerExternalEventsTest-808661776 tempest-ServerExternalEventsTest-808661776-project-member] Enqueued Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 612.121504] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9389aaed-1ad6-48d4-af15-236c6a035cba with Priority: HIGHEST for action security_group_members [ 612.121811] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9389aaed-1ad6-48d4-af15-236c6a035cba taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.121972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.123036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.123036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.123036] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.123036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.123036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.123454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.123454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.123454] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9389aaed-1ad6-48d4-af15-236c6a035cba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.219607] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.474162] env[65231]: INFO networking_nsxv3.common.synchronization [req-c54940cb-d3ce-45ef-9b69-3d479347cabf req-250b2d8e-6fc6-4cc2-ba76-1afbe01fec11 tempest-ImagesNegativeTestJSON-250869385 tempest-ImagesNegativeTestJSON-250869385-project-member] Enqueued Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 612.474814] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb with Priority: HIGHEST for action security_group_members [ 612.477764] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.477764] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.477764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.477764] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7c7dcc-21d1-45b3-b34e-4d29c652aefb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.594464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 612.597488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.597926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.598266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.598389] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.625187] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.625504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.625575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.625793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.625987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.626101] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.626198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.626350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.626421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.626500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.626585] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9389aaed-1ad6-48d4-af15-236c6a035cba is going to be updated. [ 612.657128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.657681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.657888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.658154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.658625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.668311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: IN_PROGRESS for 2s [ 612.721146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.724105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.724105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.724105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.724105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.724105] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 is going to be created. [ 612.748608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.748748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.748823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.749139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.750159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.761774] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: UNINITIALIZED for 2s [ 612.767145] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b02531e6-c351-452b-aaef-9b0dc127b4ef None None] Enqueued Resource ID: 24de6c02-b7d0-45e2-a27c-331751ef45b4 with Priority: HIGHEST for action port [ 612.767713] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24de6c02-b7d0-45e2-a27c-331751ef45b4 with Priority: HIGHEST for action port [ 612.768123] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-24de6c02-b7d0-45e2-a27c-331751ef45b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.768310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24de6c02-b7d0-45e2-a27c-331751ef45b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.768441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24de6c02-b7d0-45e2-a27c-331751ef45b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.768718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24de6c02-b7d0-45e2-a27c-331751ef45b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.768804] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24de6c02-b7d0-45e2-a27c-331751ef45b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.984039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.984039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.984039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.984039] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb is going to be updated. [ 613.021438] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.021438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.021626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.021669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.021839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.039334] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: IN_PROGRESS for 2s [ 613.103320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.103320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.103320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.103320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.105224] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.105224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.105224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.105224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.105224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.105224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.105224] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.113201] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f5cbbf78-096e-49f4-bdee-0f2739f7a5c4 None None] Enqueued Resource ID: c88262cd-0071-4d27-b4a6-4420a6df30ed with Priority: HIGHEST for action port [ 613.113201] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88262cd-0071-4d27-b4a6-4420a6df30ed with Priority: HIGHEST for action port [ 613.113201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c88262cd-0071-4d27-b4a6-4420a6df30ed taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.113201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c88262cd-0071-4d27-b4a6-4420a6df30ed" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.113201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c88262cd-0071-4d27-b4a6-4420a6df30ed" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.113201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c88262cd-0071-4d27-b4a6-4420a6df30ed" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.113936] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c88262cd-0071-4d27-b4a6-4420a6df30ed',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.270637] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24de6c02-b7d0-45e2-a27c-331751ef45b4 [ 613.271092] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.271092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.271215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.271456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.271645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.271717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24de6c02-b7d0-45e2-a27c-331751ef45b4 already deleted. [ 613.271857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24de6c02-b7d0-45e2-a27c-331751ef45b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.607763] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.608269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.608327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.608662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.608824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.609031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.609117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.610228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.610399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.610509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.610700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.610835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.610880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.611489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.611489] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.611489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.611489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.611783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.611783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.611783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.611783] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.616383] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c88262cd-0071-4d27-b4a6-4420a6df30ed [ 613.616383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.616543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.616586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.616898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.616898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.617027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c88262cd-0071-4d27-b4a6-4420a6df30ed already deleted. [ 613.617027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c88262cd-0071-4d27-b4a6-4420a6df30ed" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.115676] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 070cab8d-4383-4e42-847f-e29c9f10471f: rpc.has_security_group_logging(os_id): False [ 614.141201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.141433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.141433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.145365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.145452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.146351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.146351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.146351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.146351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.146351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.146760] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.146760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.146760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.146885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.146885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.148030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.149028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.149028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.149028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.149028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.149028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 614.218420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.218420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.218420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.218420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.218420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.248575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 614.682196] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9389aaed-1ad6-48d4-af15-236c6a035cba in Status: SUCCESS [ 614.682954] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9389aaed-1ad6-48d4-af15-236c6a035cba deletion is rescheduled due to dependency. [ 614.683215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9389aaed-1ad6-48d4-af15-236c6a035cba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.773179] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: SUCCESS [ 614.773179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.773179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.773398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.773640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.773878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.774031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.774494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.774494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.774494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.774494] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.052337] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb in Status: SUCCESS [ 615.052697] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7c7dcc-21d1-45b3-b34e-4d29c652aefb deletion is rescheduled due to dependency. [ 615.052752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7c7dcc-21d1-45b3-b34e-4d29c652aefb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.281268] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.349182] env[65231]: INFO networking_nsxv3.common.synchronization [None req-67caf4f5-288c-4bde-b63e-a072d491e669 tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 615.349879] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 615.350045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.350170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.350254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.350570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.350700] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.450216] env[65231]: INFO networking_nsxv3.common.synchronization [None req-55ea0731-3b1b-4690-b1cf-2179b4632cc2 tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 615.450216] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 615.450457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.450457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.783135] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e78acfd0-0636-44da-8f92-638d0b04c956: rpc.has_security_group_logging(os_id): False [ 615.804317] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.804487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.804547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.804780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.804876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.805153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.805232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.805470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.805614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.805614] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 is going to be created. [ 615.873110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.873595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.874045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.874312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.874550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.874915] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 already deleted. [ 615.874981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.875183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.875596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.875596] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.878258] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.878600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.878664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.879142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.879142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.893819] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: IN_PROGRESS for 2s [ 616.263255] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 616.263255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.402787] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.402787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.402787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.402787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.402787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.402787] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 already deleted. [ 616.402787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.270476] env[65231]: INFO networking_nsxv3.common.synchronization [req-d26d63f6-5c77-49b4-857a-eb1b06c58a15 req-a12c496b-72d3-4c56-9748-c897f197cace tempest-SecurityGroupRulesNegativeTestJSON-647629376 tempest-SecurityGroupRulesNegativeTestJSON-647629376-project-member] Enqueued Resource ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b with Priority: HIGHEST for action security_group_rules [ 617.271080] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b with Priority: HIGHEST for action security_group_rules [ 617.271388] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.271507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.271572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.271889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.271982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da7f800-aea4-4c3a-9799-e7a42ff9638b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.800238] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.800238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.800238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.800238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.800238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.800238] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b already deleted. [ 617.800238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.906421] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: SUCCESS [ 617.906882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.786286] env[65231]: INFO networking_nsxv3.common.synchronization [req-0f7d067a-1888-4dcf-a999-27b63e685103 req-d27cb162-18c4-4eea-9b1b-c6d590e810be tempest-SecurityGroupRulesNegativeTestJSON-647629376 tempest-SecurityGroupRulesNegativeTestJSON-647629376-project-member] Enqueued Resource ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b with Priority: HIGHEST for action security_group_rules [ 620.788316] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b with Priority: HIGHEST for action security_group_rules [ 620.788863] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.789125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.790849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.790849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.790849] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4da7f800-aea4-4c3a-9799-e7a42ff9638b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.304861] env[65231]: INFO networking_nsxv3.common.synchronization [None req-38fed0d4-e4b2-4e34-8eb5-f244adb8afc4 None None] Enqueued Resource ID: bc85acdd-4bbc-4790-a05d-39956139548e with Priority: HIGHEST for action port [ 621.305587] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc85acdd-4bbc-4790-a05d-39956139548e with Priority: HIGHEST for action port [ 621.309478] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc85acdd-4bbc-4790-a05d-39956139548e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.309689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc85acdd-4bbc-4790-a05d-39956139548e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.309797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc85acdd-4bbc-4790-a05d-39956139548e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.310162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc85acdd-4bbc-4790-a05d-39956139548e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.310457] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc85acdd-4bbc-4790-a05d-39956139548e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.321673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.321673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.321772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.322194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.322194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.322194] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4da7f800-aea4-4c3a-9799-e7a42ff9638b already deleted. [ 621.322442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4da7f800-aea4-4c3a-9799-e7a42ff9638b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.656295] env[65231]: INFO networking_nsxv3.common.synchronization [req-a8291940-fe86-439c-b3e4-174da290b639 req-6a76b504-d1a3-4a4f-a041-abb9128ffdb5 tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 621.658022] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 621.658022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.658022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.658022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.660426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.660426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.660426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.660426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.660426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.660426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.660426] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.814752] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc85acdd-4bbc-4790-a05d-39956139548e [ 621.815105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.815296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.815414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.815651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.815774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.815888] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc85acdd-4bbc-4790-a05d-39956139548e already deleted. [ 621.816051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc85acdd-4bbc-4790-a05d-39956139548e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.161409] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.665238] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.169378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.169806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.169806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.170076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.170194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.170334] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 623.200246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.200246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.200246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.200246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.200246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.212127] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 624.016319] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ba3bd3ed-e427-4aac-a796-28bb7fb93932 None None] Enqueued Resource ID: bb475556-4cf5-4c60-8680-d9f18dc64a3c with Priority: HIGHEST for action port [ 624.016902] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb475556-4cf5-4c60-8680-d9f18dc64a3c with Priority: HIGHEST for action port [ 624.017229] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb475556-4cf5-4c60-8680-d9f18dc64a3c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.017477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb475556-4cf5-4c60-8680-d9f18dc64a3c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.017477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb475556-4cf5-4c60-8680-d9f18dc64a3c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.017931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb475556-4cf5-4c60-8680-d9f18dc64a3c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.017931] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb475556-4cf5-4c60-8680-d9f18dc64a3c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.522250] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb475556-4cf5-4c60-8680-d9f18dc64a3c [ 624.522540] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.522540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.522650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.522796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.522964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.523272] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb475556-4cf5-4c60-8680-d9f18dc64a3c already deleted. [ 624.523272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb475556-4cf5-4c60-8680-d9f18dc64a3c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.080827] env[65231]: INFO networking_nsxv3.common.synchronization [None req-cb29f688-97c1-48c1-aa86-2239e83c3666 None None] Enqueued Resource ID: 2cb94a7e-d9da-4566-a63d-0faa724efb6d with Priority: HIGHEST for action port [ 625.081404] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cb94a7e-d9da-4566-a63d-0faa724efb6d with Priority: HIGHEST for action port [ 625.081707] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cb94a7e-d9da-4566-a63d-0faa724efb6d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.081831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cb94a7e-d9da-4566-a63d-0faa724efb6d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.081901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cb94a7e-d9da-4566-a63d-0faa724efb6d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.084442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cb94a7e-d9da-4566-a63d-0faa724efb6d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.085096] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cb94a7e-d9da-4566-a63d-0faa724efb6d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.202197] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ef0c55d0-25af-4ad5-ba96-bc594486e47b tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 625.202668] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 625.202976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.205042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.205142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.205409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.205497] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.236529] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 625.237089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.317353] env[65231]: INFO networking_nsxv3.common.synchronization [None req-5e061aa3-7c0f-4711-9f9c-f7620c254d6b tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 625.318095] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 625.318291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.318392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.588684] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cb94a7e-d9da-4566-a63d-0faa724efb6d [ 625.589021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.589871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.589978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.590320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.590502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.590631] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cb94a7e-d9da-4566-a63d-0faa724efb6d already deleted. [ 625.590725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cb94a7e-d9da-4566-a63d-0faa724efb6d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.727230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.727421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.727421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.727624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.727949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.728064] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf already deleted. [ 625.728282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.728349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.728562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.728562] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.254132] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.254459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.254459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.254660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.254739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.254789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf already deleted. [ 626.254844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.455943] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ce067d0-984c-4f26-b784-bd8d0f402db0 req-2afac196-77d4-4966-8193-2e94d30ccfec tempest-InstanceActionsNegativeTestJSON-1491853290 tempest-InstanceActionsNegativeTestJSON-1491853290-project-member] Enqueued Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 628.456358] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 628.457710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.457710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.457710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.458017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.458737] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.458907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.458985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.459234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.459340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.459464] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.892034] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.892243] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-292" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.892680] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-292" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.892680] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-292" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.892973] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.894490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.894630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.894911] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.895123] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.895323] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.895421] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.895526] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.895626] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.896905] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.896905] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.896905] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.922083] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.922083] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.922083] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.922083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-292" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.922083] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-9e69bdca-635f-4174-9214-3a805ce36c95 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.922083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.922083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.922083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.922083] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e69bdca-635f-4174-9214-3a805ce36c95',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.964126] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.964366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.964366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.964578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.964680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.964874] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.964969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.965040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.965195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.965268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.965364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b384100c-460b-4c13-8f1d-ec90af9ef06d already deleted. [ 628.965419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.423741] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.424632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.424632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.424632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.424632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.424632] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 9e69bdca-635f-4174-9214-3a805ce36c95 not found, creating... [ 629.424893] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.425052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.425167] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.425384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.425500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.425774] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.425919] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.426040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.426243] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.426404] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.427094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 9e69bdca-635f-4174-9214-3a805ce36c95 is going to be created. [ 629.454973] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.455354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.455354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.455542] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.455886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.455996] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.612097] env[65231]: INFO networking_nsxv3.common.synchronization [None req-3d4adeec-10ff-49fc-a23e-6d9d7920d6b4 None None] Enqueued Resource ID: 000844e7-70b1-4b47-aadc-b29780820d64 with Priority: HIGHEST for action port [ 629.612378] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000844e7-70b1-4b47-aadc-b29780820d64 with Priority: HIGHEST for action port [ 629.612936] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-000844e7-70b1-4b47-aadc-b29780820d64 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.613176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-000844e7-70b1-4b47-aadc-b29780820d64" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.613176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-000844e7-70b1-4b47-aadc-b29780820d64" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.613382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-000844e7-70b1-4b47-aadc-b29780820d64" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.613470] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000844e7-70b1-4b47-aadc-b29780820d64',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.115953] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 000844e7-70b1-4b47-aadc-b29780820d64 [ 630.116339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.116457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.116457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.119465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.119465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.119465] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:000844e7-70b1-4b47-aadc-b29780820d64 already deleted. [ 630.119465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-000844e7-70b1-4b47-aadc-b29780820d64" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.246366] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ce067d0-984c-4f26-b784-bd8d0f402db0 req-b5747e8f-1043-4a1e-8729-4da340fec8f5 service nova] Enqueued Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_rules [ 630.246625] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ce067d0-984c-4f26-b784-bd8d0f402db0 req-b5747e8f-1043-4a1e-8729-4da340fec8f5 service nova] Enqueued Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 630.246789] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ce067d0-984c-4f26-b784-bd8d0f402db0 req-b5747e8f-1043-4a1e-8729-4da340fec8f5 service nova] Enqueued Resource ID: 9e69bdca-635f-4174-9214-3a805ce36c95 with Priority: HIGHEST for action port [ 630.247584] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_rules [ 630.247754] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 630.247754] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e69bdca-635f-4174-9214-3a805ce36c95 with Priority: HIGHEST for action port [ 630.248474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.248474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.248474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.248709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.248709] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.251482] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.251482] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.251482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.251482] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.256313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e69bdca-635f-4174-9214-3a805ce36c95 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.256313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.256313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.256313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.256313] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e69bdca-635f-4174-9214-3a805ce36c95',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.755601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.756044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.756455] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.762274] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e69bdca-635f-4174-9214-3a805ce36c95 with status ACTIVE [ 630.762497] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.762630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.762733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.763122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.763122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.763251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.763376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.763449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.763663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.763766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.764036] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.764186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.764261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.764447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.764557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.764667] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e69bdca-635f-4174-9214-3a805ce36c95 is going to be updated. [ 630.793688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.793920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.793966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.794169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.794343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.794544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e69bdca-635f-4174-9214-3a805ce36c95" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.906758] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9f62fd11-f9af-43a5-96f2-d72cfec1a44d None None] Enqueued Resource ID: f9ee9074-364c-40d2-93e7-ddde4c8d3860 with Priority: HIGHEST for action port [ 630.907705] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ee9074-364c-40d2-93e7-ddde4c8d3860 with Priority: HIGHEST for action port [ 630.908064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ee9074-364c-40d2-93e7-ddde4c8d3860 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.908218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ee9074-364c-40d2-93e7-ddde4c8d3860" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.908720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ee9074-364c-40d2-93e7-ddde4c8d3860" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.910380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ee9074-364c-40d2-93e7-ddde4c8d3860" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.911143] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ee9074-364c-40d2-93e7-ddde4c8d3860',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.262547] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.416108] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9ee9074-364c-40d2-93e7-ddde4c8d3860 [ 631.416108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.416108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.416108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.416108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.416108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.416108] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9ee9074-364c-40d2-93e7-ddde4c8d3860 already deleted. [ 631.416108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ee9074-364c-40d2-93e7-ddde4c8d3860" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.765844] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.766191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.766191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.766308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.766445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.766483] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b384100c-460b-4c13-8f1d-ec90af9ef06d is going to be created. [ 631.795484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.795484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.795484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.795484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.795484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.806333] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: UNINITIALIZED for 2s [ 633.141819] env[65231]: INFO networking_nsxv3.common.synchronization [None req-77e83aca-ea05-4a33-86c0-2217cdd94d2a None None] Enqueued Resource ID: 722ee0e8-9d5b-4259-8690-420615551fc6 with Priority: HIGHEST for action port [ 633.142385] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722ee0e8-9d5b-4259-8690-420615551fc6 with Priority: HIGHEST for action port [ 633.142687] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-722ee0e8-9d5b-4259-8690-420615551fc6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.143824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-722ee0e8-9d5b-4259-8690-420615551fc6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.145034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-722ee0e8-9d5b-4259-8690-420615551fc6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.145636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-722ee0e8-9d5b-4259-8690-420615551fc6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.145636] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('722ee0e8-9d5b-4259-8690-420615551fc6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.630693] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b127dd4a-3d3f-4dae-b4fe-e30140c35a8b None None] Enqueued Resource ID: 0a3bdf71-21b2-4742-9847-2828bc2353d7 with Priority: HIGHEST for action port [ 633.630693] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3bdf71-21b2-4742-9847-2828bc2353d7 with Priority: HIGHEST for action port [ 633.630965] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a3bdf71-21b2-4742-9847-2828bc2353d7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.631105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a3bdf71-21b2-4742-9847-2828bc2353d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.631173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a3bdf71-21b2-4742-9847-2828bc2353d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.631420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a3bdf71-21b2-4742-9847-2828bc2353d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.631502] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a3bdf71-21b2-4742-9847-2828bc2353d7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.649742] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 722ee0e8-9d5b-4259-8690-420615551fc6 [ 633.650025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.650320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.650431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.650677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.650811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.650924] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:722ee0e8-9d5b-4259-8690-420615551fc6 already deleted. [ 633.652561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-722ee0e8-9d5b-4259-8690-420615551fc6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.818594] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: SUCCESS [ 633.818826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.818993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.819244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.819462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.819580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.819640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.821170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.821304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.821399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.821520] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.107583] env[65231]: INFO networking_nsxv3.common.synchronization [req-cbaaa9d6-80dd-423f-9e63-42eddf7b834b req-d7d6c712-05da-4b05-843e-0670d7042cb3 tempest-ServerDiagnosticsNegativeTest-99429830 tempest-ServerDiagnosticsNegativeTest-99429830-project-member] Enqueued Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 634.108225] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 634.108673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.108673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.108874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.112137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.112137] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.112137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.112137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.112137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.112137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.112137] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.135672] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a3bdf71-21b2-4742-9847-2828bc2353d7 [ 634.136221] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.136633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.136633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.136772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.136826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.136876] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a3bdf71-21b2-4742-9847-2828bc2353d7 already deleted. [ 634.137189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a3bdf71-21b2-4742-9847-2828bc2353d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.326608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.326948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.326948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.327222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.327222] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.327317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.327478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.327552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.327604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.327738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.327825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.327907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.327974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.328119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.328252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.328389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.328454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.328608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.328693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.328812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.328869] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.430817] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f3a00d05-0fcf-4bef-8f0f-fc6799ae71b7 None None] Enqueued Resource ID: 99700f78-dd57-4035-ab05-a2eb0de9c0fc with Priority: HIGHEST for action port [ 634.431078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99700f78-dd57-4035-ab05-a2eb0de9c0fc with Priority: HIGHEST for action port [ 634.431797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-99700f78-dd57-4035-ab05-a2eb0de9c0fc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.431797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99700f78-dd57-4035-ab05-a2eb0de9c0fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.431797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99700f78-dd57-4035-ab05-a2eb0de9c0fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.432063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99700f78-dd57-4035-ab05-a2eb0de9c0fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.432155] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99700f78-dd57-4035-ab05-a2eb0de9c0fc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.606692] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.606955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.607670] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.607670] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.607908] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.608047] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.608342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.608482] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.608561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.608713] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.608837] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.608905] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.609057] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.609238] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.609238] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.609455] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.615840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.616119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.616210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.616338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.616428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.616633] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.616837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.616837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.617255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.617255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.617255] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 already deleted. [ 634.617255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.632120] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.632333] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.632662] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.632739] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.637756] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-a425d014-ccd6-475d-8356-058edb86f566 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.638094] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.638228] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.638574] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.638714] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a425d014-ccd6-475d-8356-058edb86f566',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.833607] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b384100c-460b-4c13-8f1d-ec90af9ef06d: rpc.has_security_group_logging(os_id): False [ 634.855423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.855626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.855689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.856012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.856118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.856370] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.856459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.856531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.856733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.856830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.857093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.857211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.858296] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.858296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.858296] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b384100c-460b-4c13-8f1d-ec90af9ef06d is going to be created. [ 634.931471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.931633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.931633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.932513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.932513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.934671] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99700f78-dd57-4035-ab05-a2eb0de9c0fc [ 634.934899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.935047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.935109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.935326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.936706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.936706] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99700f78-dd57-4035-ab05-a2eb0de9c0fc already deleted. [ 634.936706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99700f78-dd57-4035-ab05-a2eb0de9c0fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.943987] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: IN_PROGRESS for 2s [ 635.143519] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.145115] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.145115] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.145400] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.145557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.145712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port a425d014-ccd6-475d-8356-058edb86f566 not found, creating... [ 635.145982] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.146154] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.146265] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.146577] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.149342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.149342] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.149342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.149342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.149342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.149342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.149342] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: a425d014-ccd6-475d-8356-058edb86f566 is going to be created. [ 635.170096] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.170380] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.170502] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.170966] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.173463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.173463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.929749] env[65231]: INFO networking_nsxv3.common.synchronization [req-cbaaa9d6-80dd-423f-9e63-42eddf7b834b req-f4f524cc-58f0-4af3-81cd-0dfec03524cc service nova] Enqueued Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_rules [ 635.930059] env[65231]: INFO networking_nsxv3.common.synchronization [req-cbaaa9d6-80dd-423f-9e63-42eddf7b834b req-f4f524cc-58f0-4af3-81cd-0dfec03524cc service nova] Enqueued Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 635.930059] env[65231]: INFO networking_nsxv3.common.synchronization [req-cbaaa9d6-80dd-423f-9e63-42eddf7b834b req-f4f524cc-58f0-4af3-81cd-0dfec03524cc service nova] Enqueued Resource ID: a425d014-ccd6-475d-8356-058edb86f566 with Priority: HIGHEST for action port [ 635.930704] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_rules [ 635.930704] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 635.930836] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a425d014-ccd6-475d-8356-058edb86f566 with Priority: HIGHEST for action port [ 635.931483] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.931483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.931483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.931662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.931662] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.932711] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.932711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.932711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.933058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.933058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.933058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.934262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.934262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.934262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.934262] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.936452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a425d014-ccd6-475d-8356-058edb86f566 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.936452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.936452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.936643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.936643] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a425d014-ccd6-475d-8356-058edb86f566',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.131896] env[65231]: INFO networking_nsxv3.common.synchronization [req-61e654ee-64e8-4104-8a1c-7c052ba491f8 req-bbab8377-cd03-450c-85be-3f8450bbef8b tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 636.132476] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 636.133094] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.133094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.133094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.133340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.133652] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.133652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.133652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.134273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.134273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.134273] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.440940] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.440940] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.440940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.445494] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a425d014-ccd6-475d-8356-058edb86f566 with status ACTIVE [ 636.445494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.445494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.445494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.445494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.445494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.445494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.445966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.445966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.445966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.445966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.446161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.446703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.446795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.447589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.447679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.447773] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a425d014-ccd6-475d-8356-058edb86f566 is going to be updated. [ 636.474700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.474700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.474700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.474700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.474700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.474700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a425d014-ccd6-475d-8356-058edb86f566" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.526582] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.526582] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.526582] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.526582] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.526582] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.527429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.527617] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.527919] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.528146] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.528416] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.528689] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.528846] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.529040] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.529235] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.529416] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.529590] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.559050] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.559050] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.559050] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.559050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.560643] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.560643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.560643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.561048] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.561048] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.637277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.637277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.637277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.637507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.637507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.637780] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.637780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.637935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.638011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.638089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.638172] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 already deleted. [ 636.638253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.945331] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.962557] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: SUCCESS [ 636.963489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.065072] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.065072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.065072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.065072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.065072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.065072] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c not found, creating... [ 637.065072] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.065560] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.065560] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.065560] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.065655] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.066108] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.071846] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.071846] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.072277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.072957] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.073260] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c is going to be created. [ 637.099120] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.099599] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.100187] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.101677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.101677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.102051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.429096] env[65231]: INFO networking_nsxv3.common.synchronization [None req-99e43a33-b0a0-42c9-a8a1-bf9cfd7c11fc None None] Enqueued Resource ID: 09a82fd3-70ff-4fbd-9181-df69ef7aa443 with Priority: HIGHEST for action port [ 637.429998] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09a82fd3-70ff-4fbd-9181-df69ef7aa443 with Priority: HIGHEST for action port [ 637.430596] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-09a82fd3-70ff-4fbd-9181-df69ef7aa443 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.430922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09a82fd3-70ff-4fbd-9181-df69ef7aa443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.432806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09a82fd3-70ff-4fbd-9181-df69ef7aa443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.432806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09a82fd3-70ff-4fbd-9181-df69ef7aa443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.432806] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09a82fd3-70ff-4fbd-9181-df69ef7aa443',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.450367] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.450518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.450573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.450748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.450837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.450967] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 is going to be created. [ 637.475968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.476149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.476202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.476418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.476589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.488063] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: UNINITIALIZED for 2s [ 637.935811] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09a82fd3-70ff-4fbd-9181-df69ef7aa443 [ 637.935811] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.936483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.936622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.936870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.936977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.937410] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09a82fd3-70ff-4fbd-9181-df69ef7aa443 already deleted. [ 637.937559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09a82fd3-70ff-4fbd-9181-df69ef7aa443" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.173657] env[65231]: INFO networking_nsxv3.common.synchronization [None req-aafc6b62-df87-4572-9266-1eab2ee765d1 None None] Enqueued Resource ID: cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee with Priority: HIGHEST for action port [ 638.174563] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee with Priority: HIGHEST for action port [ 638.174563] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.174712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.174712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.175046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.175227] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [req-61e654ee-64e8-4104-8a1c-7c052ba491f8 req-76fb28a3-8f8f-4df4-841c-2059ff1d7c89 service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [req-61e654ee-64e8-4104-8a1c-7c052ba491f8 req-76fb28a3-8f8f-4df4-841c-2059ff1d7c89 service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [req-61e654ee-64e8-4104-8a1c-7c052ba491f8 req-76fb28a3-8f8f-4df4-841c-2059ff1d7c89 service nova] Enqueued Resource ID: b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c with Priority: HIGHEST for action port [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 638.358177] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c with Priority: HIGHEST for action port [ 638.358177] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.359042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.359133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.359371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.359452] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.360396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.360489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.360578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.360804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.360976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.361112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.361179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.361721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.361721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.361721] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.364077] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.364077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.364077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.364077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.364077] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.677343] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee [ 638.677606] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.677731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.678895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.678895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.678895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.678895] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee already deleted. [ 638.678895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbf9abb4-7ced-4f8a-86d8-4d97739cf7ee" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.864578] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.864765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.864971] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.866714] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c with status ACTIVE [ 638.866888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.867017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.868256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.868554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.868696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.868972] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.871165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.871246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.871457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.871512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.871720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.871826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.871962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.872141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.872217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.872328] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c is going to be updated. [ 638.898572] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.898760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.898842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.899064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.899206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.899413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96f3bb9-2dd8-44d0-ab35-58e52c9cd32c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.376111] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.503867] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: SUCCESS [ 639.504271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.504627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.508160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.508160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.508515] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.880768] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.882431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.882431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.882431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.882431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.882431] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be created. [ 639.907834] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.908192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.908365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.908760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.909067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.920371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: UNINITIALIZED for 2s [ 640.011942] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.011942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.011942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.012262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.012511] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.012624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.012742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.012998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.013190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.013397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.013558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.013727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.013821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.014054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.014302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.014496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.014617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.014881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.015029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.015131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.015242] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.168216] env[65231]: INFO networking_nsxv3.common.synchronization [req-50109135-4a73-4234-889d-594a59280136 req-c68f97d0-e725-43ce-8737-beef4a6c5d49 tempest-ServersV294TestFqdnHostnames-472328194 tempest-ServersV294TestFqdnHostnames-472328194-project-member] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 640.168594] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 640.169016] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.169154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.169290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.169601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.170048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.170048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.170048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.170247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.170367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.170503] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.518948] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 089102e4-f74e-4139-88d6-a79e9f27e9c1: rpc.has_security_group_logging(os_id): False [ 640.546024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.546024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.546024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.546024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.546024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.547992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.547992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.547992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.550816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.550816] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.550816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.550816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.550816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.550816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.550816] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 is going to be created. [ 640.624037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.624037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.624037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.624261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.624261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.634335] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: IN_PROGRESS for 2s [ 640.639765] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.639765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-421" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.639765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-421" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.639765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-421" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.639765] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.640156] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.640156] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.640302] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.640440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.640635] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.640837] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.640837] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.640959] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.641071] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.641133] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.642067] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.660765] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.660765] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.660765] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.661229] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-421" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.661229] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.661384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.661384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.661697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.661829] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c4e927-1311-4cc1-950a-97f2b8ce7a84',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.673877] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.674158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.674158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.674310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.674398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.674580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.674672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.674731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.674920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.675169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.675169] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b already deleted. [ 640.675169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.166750] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.166750] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port e5c4e927-1311-4cc1-950a-97f2b8ce7a84 not found, creating... [ 641.166750] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.166750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.167231] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.167231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.167231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.167231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.167231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.168476] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: e5c4e927-1311-4cc1-950a-97f2b8ce7a84 is going to be created. [ 641.192479] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.192725] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.192850] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.193143] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.193364] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.193595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.695599] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f5767e8f-e5ad-4612-b660-46f8380c2e27 None None] Enqueued Resource ID: 9b098e34-e3c1-48cc-8d7b-641fd63c9440 with Priority: HIGHEST for action port [ 641.696234] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b098e34-e3c1-48cc-8d7b-641fd63c9440 with Priority: HIGHEST for action port [ 641.696539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b098e34-e3c1-48cc-8d7b-641fd63c9440 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.696940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b098e34-e3c1-48cc-8d7b-641fd63c9440" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.697261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b098e34-e3c1-48cc-8d7b-641fd63c9440" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.697685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b098e34-e3c1-48cc-8d7b-641fd63c9440" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.697791] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b098e34-e3c1-48cc-8d7b-641fd63c9440',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.930939] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 641.931401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.931687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.932308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.932308] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.932538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.932619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.933235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.933235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.933235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.933235] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.968729] env[65231]: INFO networking_nsxv3.common.synchronization [req-50109135-4a73-4234-889d-594a59280136 req-d3c0f059-0b18-4eaf-bf4b-8e86739fa937 service nova] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 641.968936] env[65231]: INFO networking_nsxv3.common.synchronization [req-50109135-4a73-4234-889d-594a59280136 req-d3c0f059-0b18-4eaf-bf4b-8e86739fa937 service nova] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 641.969108] env[65231]: INFO networking_nsxv3.common.synchronization [req-50109135-4a73-4234-889d-594a59280136 req-d3c0f059-0b18-4eaf-bf4b-8e86739fa937 service nova] Enqueued Resource ID: e5c4e927-1311-4cc1-950a-97f2b8ce7a84 with Priority: HIGHEST for action port [ 641.969385] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_rules [ 641.969540] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 641.969616] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c4e927-1311-4cc1-950a-97f2b8ce7a84 with Priority: HIGHEST for action port [ 641.970310] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.970477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.971256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.971428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.971642] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.973261] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.973345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.973441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.973634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.974314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.974534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.974683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.975090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.975285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.975558] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.976718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.977188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.977353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.977625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.978061] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c4e927-1311-4cc1-950a-97f2b8ce7a84',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.200086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b098e34-e3c1-48cc-8d7b-641fd63c9440 [ 642.200370] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.201975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.201975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.201975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.201975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.201975] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b098e34-e3c1-48cc-8d7b-641fd63c9440 already deleted. [ 642.201975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b098e34-e3c1-48cc-8d7b-641fd63c9440" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.435694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.436827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.436827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.437072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.437288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.437946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.438037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.438208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.438301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.438391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.438767] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.438876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.438937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.439099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.439835] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.439835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.439835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.439835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.439835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.439835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.439835] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.473591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.473721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.480249] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.481297] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5c4e927-1311-4cc1-950a-97f2b8ce7a84 with status ACTIVE [ 642.481553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.481725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.481805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.482073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.482140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.482312] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.482465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.482465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.482624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.482708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.482959] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.483778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.483860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.484260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.484361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.484458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5c4e927-1311-4cc1-950a-97f2b8ce7a84 is going to be updated. [ 642.509475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.509475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.509475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.509475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.509475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.509475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c4e927-1311-4cc1-950a-97f2b8ce7a84" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.555983] env[65231]: INFO networking_nsxv3.common.synchronization [req-45756a60-fa4e-4246-96d0-008cc00075da req-83acbaa9-33d6-4c1d-96fb-f4313902563f tempest-DeleteServersAdminTestJSON-1674141270 tempest-DeleteServersAdminTestJSON-1674141270-project-member] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 642.556896] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 642.556896] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.556896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.557116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.557297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.557482] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.557639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.557739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.557935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.558078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.558221] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.651245] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: SUCCESS [ 642.651580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.942305] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 642.958532] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.958680] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.958748] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.958962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.959222] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.959814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.959814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.959814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.959814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.960235] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.960314] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.960364] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.960471] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.960845] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.960845] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.960845] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.971784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.972098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.972098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.972355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.972423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.972680] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.972789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.972855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.973085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.973412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.973507] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.973606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.973659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.973810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.973919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.974281] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.974404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.974458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.974607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.974700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.974763] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be created. [ 642.983136] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.983275] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.983410] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.983632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.984040] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.984222] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.984418] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.985300] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.985300] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.987149] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.047803] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.051110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.051110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.051110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.051110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.061313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.061544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.061544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.061794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.063881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.063881] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.063881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.063881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.063881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.063881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.063881] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be updated. [ 643.064465] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 643.096850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.097126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.097246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.097566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.097772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.108583] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 643.489845] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.493023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f not found, creating... [ 643.493023] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.493023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.493815] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.493815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.494756] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.498118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f is going to be created. [ 643.498118] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.498118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.498118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b is going to be created. [ 643.520819] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.522672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.522672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.522672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.522672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.522672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.524367] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.524494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.524494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.524646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.524794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.536375] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: UNINITIALIZED for 2s [ 644.052429] env[65231]: INFO networking_nsxv3.common.synchronization [None req-4481f2b8-97ad-46cc-90e2-a1706e5e916a None None] Enqueued Resource ID: c68c03ff-e22b-4615-a611-4ac9d329903b with Priority: HIGHEST for action port [ 644.054490] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68c03ff-e22b-4615-a611-4ac9d329903b with Priority: HIGHEST for action port [ 644.057037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c68c03ff-e22b-4615-a611-4ac9d329903b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.057037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c68c03ff-e22b-4615-a611-4ac9d329903b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.057037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c68c03ff-e22b-4615-a611-4ac9d329903b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.057037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c68c03ff-e22b-4615-a611-4ac9d329903b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.057037] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c68c03ff-e22b-4615-a611-4ac9d329903b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.302276] env[65231]: INFO networking_nsxv3.common.synchronization [req-45756a60-fa4e-4246-96d0-008cc00075da req-aa748bd9-ab24-4c9c-880c-d1a43033a5f0 service nova] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_rules [ 644.303601] env[65231]: INFO networking_nsxv3.common.synchronization [req-45756a60-fa4e-4246-96d0-008cc00075da req-aa748bd9-ab24-4c9c-880c-d1a43033a5f0 service nova] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 644.303601] env[65231]: INFO networking_nsxv3.common.synchronization [req-45756a60-fa4e-4246-96d0-008cc00075da req-aa748bd9-ab24-4c9c-880c-d1a43033a5f0 service nova] Enqueued Resource ID: c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f with Priority: HIGHEST for action port [ 644.307737] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_rules [ 644.307737] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 644.307737] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f with Priority: HIGHEST for action port [ 644.307737] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.307737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.307737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.307737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.307737] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.308660] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.308660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.308825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.308932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.309048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.309288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.310313] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.561423] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c68c03ff-e22b-4615-a611-4ac9d329903b [ 644.561685] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.561831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.561896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.562671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.566032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.566032] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c68c03ff-e22b-4615-a611-4ac9d329903b already deleted. [ 644.566032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c68c03ff-e22b-4615-a611-4ac9d329903b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.813839] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.814054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.816819] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f with status ACTIVE [ 644.816819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.816819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.816819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.816819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.817644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.817644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.817644] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f is going to be updated. [ 644.839861] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.840075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.840494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.840494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.840617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.840732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c624dc6d-9dbb-4cfe-8f62-bb683e45ab5f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.078559] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 645.078895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.128094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 645.128314] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 deletion is rescheduled due to dependency. [ 645.128434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.128650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.128895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.129141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.129276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.129342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.129529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.129594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.129689] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.549680] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: SUCCESS [ 645.549810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.550209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.550378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.550470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.550685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.550685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.550827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.550930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.551037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.551138] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.634528] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.053894] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.136896] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.559051] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d2bc8-86fa-42f2-8986-0a1fae12ae1b: rpc.has_security_group_logging(os_id): False [ 646.578408] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.578569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.578665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.578888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.578964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.579249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.579343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.579408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.579577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.579679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.579775] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b is going to be created. [ 646.640654] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.640774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.640774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.641172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.641345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.641531] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be updated. [ 646.650221] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.650519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.651373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.651373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.666872] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: IN_PROGRESS for 2s [ 646.679816] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.680174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.680174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.680417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.680844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.692183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 646.962764] env[65231]: INFO networking_nsxv3.common.synchronization [req-07cf99a9-177a-4e3c-8356-64da69019381 req-641e0608-2d72-43ed-8566-e095dd4c2e59 tempest-InstanceActionsNegativeTestJSON-1491853290 tempest-InstanceActionsNegativeTestJSON-1491853290-project-member] Enqueued Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 646.962764] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b384100c-460b-4c13-8f1d-ec90af9ef06d with Priority: HIGHEST for action security_group_members [ 646.962764] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b384100c-460b-4c13-8f1d-ec90af9ef06d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.962764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.962764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.963029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.963199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.963349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.963445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.964238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.964352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.965027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b384100c-460b-4c13-8f1d-ec90af9ef06d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.473088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.473088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.473088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.473691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.473691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.473691] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b384100c-460b-4c13-8f1d-ec90af9ef06d is going to be updated. [ 647.502298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.502387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.502556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.502739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.503470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.520800] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: IN_PROGRESS for 2s [ 648.684062] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: SUCCESS [ 648.684415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.703115] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 648.703115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.703313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.703502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.703694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.703899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.703983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.704174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.704261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.704348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.704438] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.712421] env[65231]: INFO networking_nsxv3.common.synchronization [None req-169079e3-ca87-4ba3-b080-52263b5f3f91 None None] Enqueued Resource ID: 6f7bd910-151d-40b9-9cb5-3001d83b4a49 with Priority: HIGHEST for action port [ 648.713160] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f7bd910-151d-40b9-9cb5-3001d83b4a49 with Priority: HIGHEST for action port [ 648.714489] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f7bd910-151d-40b9-9cb5-3001d83b4a49 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.714640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f7bd910-151d-40b9-9cb5-3001d83b4a49" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.714725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f7bd910-151d-40b9-9cb5-3001d83b4a49" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.714933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f7bd910-151d-40b9-9cb5-3001d83b4a49" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.715045] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f7bd910-151d-40b9-9cb5-3001d83b4a49',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.823588] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a5b54022-9503-4af8-a1b8-412d3d532f99 None None] Enqueued Resource ID: a46405d4-aebc-454b-ade8-686be82d76e1 with Priority: HIGHEST for action port [ 648.824375] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a46405d4-aebc-454b-ade8-686be82d76e1 with Priority: HIGHEST for action port [ 648.824771] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a46405d4-aebc-454b-ade8-686be82d76e1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.824930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a46405d4-aebc-454b-ade8-686be82d76e1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.825032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a46405d4-aebc-454b-ade8-686be82d76e1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.825378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a46405d4-aebc-454b-ade8-686be82d76e1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.825492] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a46405d4-aebc-454b-ade8-686be82d76e1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.211604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.211845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.211927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.212324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.212907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.213054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.213127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.213320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.213413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.213508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.213676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.213772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.213834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.213977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.214151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.214247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.214301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.214444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.214519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.214606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.214697] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.218718] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f7bd910-151d-40b9-9cb5-3001d83b4a49 [ 649.218926] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.219072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.219165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.219353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.219437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.219535] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f7bd910-151d-40b9-9cb5-3001d83b4a49 already deleted. [ 649.219620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f7bd910-151d-40b9-9cb5-3001d83b4a49" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.332030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a46405d4-aebc-454b-ade8-686be82d76e1 [ 649.332030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.332030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.332030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.332306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.332306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.332306] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a46405d4-aebc-454b-ade8-686be82d76e1 already deleted. [ 649.332429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a46405d4-aebc-454b-ade8-686be82d76e1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.383473] env[65231]: INFO networking_nsxv3.common.synchronization [req-054596d3-72af-4a2a-b326-c1fca875fc20 req-66445d94-5a7d-495f-9ee4-5e4f149ce60a tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 649.384145] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 649.384456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.384576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.384640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.384950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.385146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.385259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.385322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.385492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.385582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.385677] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.534086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b384100c-460b-4c13-8f1d-ec90af9ef06d in Status: SUCCESS [ 649.534780] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b384100c-460b-4c13-8f1d-ec90af9ef06d deletion is rescheduled due to dependency. [ 649.534780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b384100c-460b-4c13-8f1d-ec90af9ef06d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.717181] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee4dd131-77b2-4914-aa5f-9f4b5de030a2: rpc.has_security_group_logging(os_id): False [ 649.741081] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.741283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.741401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.741588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.741680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.741897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.742017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.742085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.743452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.743452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.743452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.745692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.745692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.745692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.745692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be updated. [ 649.774790] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.774975] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.775105] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.776287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.776287] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.776287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.776287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.780021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.780021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.780021] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.780021] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.780021] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.780021] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.780021] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.780021] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.780397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.806302] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.806302] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.806302] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.806302] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.808257] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-2b2800df-44dd-4485-9a92-722c272c2a8d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.808257] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.808257] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.808257] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.808257] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2800df-44dd-4485-9a92-722c272c2a8d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.825694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.826330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.826330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.826330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.826330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.844433] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 649.891712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.891903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.891903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.892167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.892281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.892601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.892710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.892793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.892975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.893082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.893173] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 already deleted. [ 649.893255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.062094] env[65231]: INFO networking_nsxv3.common.synchronization [req-7b9ae869-6fbc-4578-999f-a50e634ad707 req-fb1601bf-db02-4ddb-82c6-ca6115f263c4 tempest-ServersAdminNegativeTestJSON-1762838769 tempest-ServersAdminNegativeTestJSON-1762838769-project-member] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 650.062668] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 650.062968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.063253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.063321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.063516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.063687] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.063763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.063815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.063954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.064047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.064141] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.312911] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.313371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.313594] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.316031] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 2b2800df-44dd-4485-9a92-722c272c2a8d not found, creating... [ 650.316031] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.316031] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.316031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.316528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.316528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.316528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.316861] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 2b2800df-44dd-4485-9a92-722c272c2a8d is going to be created. [ 650.345182] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.345880] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.345880] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.345880] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.346058] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.346856] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.544144] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.544144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.544144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.544144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.544144] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.544706] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.544954] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.545290] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.545562] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.545898] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.546147] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.546346] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.546543] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.546850] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.547190] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.548785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.565843] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.566021] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.566176] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.566350] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.566670] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-6b86885f-08b8-465c-adbb-801c8a0c958e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.566883] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.567046] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.568047] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.568047] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b86885f-08b8-465c-adbb-801c8a0c958e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.569063] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.070722] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.071163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.071163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.071469] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.071620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.071775] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 6b86885f-08b8-465c-adbb-801c8a0c958e not found, creating... [ 651.072048] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.072210] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.072321] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.072576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.072715] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.072994] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.073592] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.073713] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.073931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.074327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.074520] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 6b86885f-08b8-465c-adbb-801c8a0c958e is going to be created. [ 651.076068] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.082551] env[65231]: INFO networking_nsxv3.common.synchronization [req-054596d3-72af-4a2a-b326-c1fca875fc20 req-3a099dee-3911-452d-a36e-1b205d149ebd service nova] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 651.082787] env[65231]: INFO networking_nsxv3.common.synchronization [req-054596d3-72af-4a2a-b326-c1fca875fc20 req-3a099dee-3911-452d-a36e-1b205d149ebd service nova] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 651.083018] env[65231]: INFO networking_nsxv3.common.synchronization [req-054596d3-72af-4a2a-b326-c1fca875fc20 req-3a099dee-3911-452d-a36e-1b205d149ebd service nova] Enqueued Resource ID: 2b2800df-44dd-4485-9a92-722c272c2a8d with Priority: HIGHEST for action port [ 651.083199] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 651.083339] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 651.083484] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2800df-44dd-4485-9a92-722c272c2a8d with Priority: HIGHEST for action port [ 651.084396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.084551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.084596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.084869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.084869] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.086239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.086367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.086435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.089680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.089904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.090098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.090169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.090404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.090503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.090615] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.095043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b2800df-44dd-4485-9a92-722c272c2a8d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.095192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.095818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.096080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.099157] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2800df-44dd-4485-9a92-722c272c2a8d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.102369] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.102563] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.102681] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.102937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.103243] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.103530] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.254018] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d737e169-8100-4eb7-9e6c-d7696ce47cbe None None] Enqueued Resource ID: 4f63bf84-f010-4c42-a502-e1ea2f6ceeb9 with Priority: HIGHEST for action port [ 651.254018] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f63bf84-f010-4c42-a502-e1ea2f6ceeb9 with Priority: HIGHEST for action port [ 651.254612] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f63bf84-f010-4c42-a502-e1ea2f6ceeb9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.256302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f63bf84-f010-4c42-a502-e1ea2f6ceeb9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.256302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f63bf84-f010-4c42-a502-e1ea2f6ceeb9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.256302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f63bf84-f010-4c42-a502-e1ea2f6ceeb9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.256302] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f63bf84-f010-4c42-a502-e1ea2f6ceeb9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.361736] env[65231]: INFO networking_nsxv3.common.synchronization [None req-df27b849-8913-46e4-8178-206e3e901b61 None None] Enqueued Resource ID: 4eaef136-e51f-4e0c-9e20-371f896a8ff7 with Priority: HIGHEST for action port [ 651.362369] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eaef136-e51f-4e0c-9e20-371f896a8ff7 with Priority: HIGHEST for action port [ 651.362717] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eaef136-e51f-4e0c-9e20-371f896a8ff7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.362857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eaef136-e51f-4e0c-9e20-371f896a8ff7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.362923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eaef136-e51f-4e0c-9e20-371f896a8ff7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.363314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eaef136-e51f-4e0c-9e20-371f896a8ff7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.363351] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eaef136-e51f-4e0c-9e20-371f896a8ff7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.579814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.580025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.580025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.580245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.580339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.580440] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be updated. [ 651.587460] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.587685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.606194] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.607457] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b2800df-44dd-4485-9a92-722c272c2a8d with status ACTIVE [ 651.607457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.607622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.607622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.607810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.608022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.608262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.608377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.608441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.608627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.608718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.608902] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.608998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.609163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.609339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.609438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.609633] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b2800df-44dd-4485-9a92-722c272c2a8d is going to be updated. [ 651.620973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.620973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.620973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.620973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.620973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.629922] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 651.635841] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.636048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.636113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.636346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.636500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.636691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b2800df-44dd-4485-9a92-722c272c2a8d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.757915] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f63bf84-f010-4c42-a502-e1ea2f6ceeb9 [ 651.757915] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.758177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.758177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.758393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.758483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.758594] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f63bf84-f010-4c42-a502-e1ea2f6ceeb9 already deleted. [ 651.758681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f63bf84-f010-4c42-a502-e1ea2f6ceeb9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.827491] env[65231]: INFO networking_nsxv3.common.synchronization [req-7b9ae869-6fbc-4578-999f-a50e634ad707 req-f1c047ec-3300-4594-b3e8-8737b8580639 service nova] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_rules [ 651.828323] env[65231]: INFO networking_nsxv3.common.synchronization [req-7b9ae869-6fbc-4578-999f-a50e634ad707 req-f1c047ec-3300-4594-b3e8-8737b8580639 service nova] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 651.828323] env[65231]: INFO networking_nsxv3.common.synchronization [req-7b9ae869-6fbc-4578-999f-a50e634ad707 req-f1c047ec-3300-4594-b3e8-8737b8580639 service nova] Enqueued Resource ID: 6b86885f-08b8-465c-adbb-801c8a0c958e with Priority: HIGHEST for action port [ 651.829856] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_rules [ 651.830101] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 651.830359] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b86885f-08b8-465c-adbb-801c8a0c958e with Priority: HIGHEST for action port [ 651.831383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.831383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.831383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.831739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.831889] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.833211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.833492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.833856] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b86885f-08b8-465c-adbb-801c8a0c958e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.834063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.834196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.835307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.835534] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b86885f-08b8-465c-adbb-801c8a0c958e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.860299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 651.861804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.867102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eaef136-e51f-4e0c-9e20-371f896a8ff7 [ 651.867102] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.867102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.867102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.867102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.867102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.867102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eaef136-e51f-4e0c-9e20-371f896a8ff7 already deleted. [ 651.867102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eaef136-e51f-4e0c-9e20-371f896a8ff7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.111658] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.337993] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.338182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.340570] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b86885f-08b8-465c-adbb-801c8a0c958e with status ACTIVE [ 652.340799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.340928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.340995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.341283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.341408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.341591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.341708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.341787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.341962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.342053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.342313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.342543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.342626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.342754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.342829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.342913] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b86885f-08b8-465c-adbb-801c8a0c958e is going to be updated. [ 652.366719] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.368973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.368973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.368973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.368973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.368973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b86885f-08b8-465c-adbb-801c8a0c958e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.615551] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.615719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.615789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.616047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.616140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.616252] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be created. [ 652.643860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.647249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.647337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.647578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.647789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.659451] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: UNINITIALIZED for 2s [ 653.647036] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 653.647036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.647710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.647710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.647710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.647710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.648387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.648387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.648387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.648387] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.107997] env[65231]: INFO networking_nsxv3.common.synchronization [req-81d051cd-59cc-4088-9234-60631aa55180 req-a4c4265e-b7b3-4baf-b2dd-573d769859a8 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: c7280c70-3aad-4146-b2b8-97445cb26a11 with Priority: HIGHEST for action security_group_rules [ 654.108567] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7280c70-3aad-4146-b2b8-97445cb26a11 with Priority: HIGHEST for action security_group_rules [ 654.108930] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7280c70-3aad-4146-b2b8-97445cb26a11 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.109112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7280c70-3aad-4146-b2b8-97445cb26a11" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.109221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7280c70-3aad-4146-b2b8-97445cb26a11" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.109475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7280c70-3aad-4146-b2b8-97445cb26a11" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.109586] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7280c70-3aad-4146-b2b8-97445cb26a11',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.152454] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.632471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.632691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.632742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.632952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.633061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.633157] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7280c70-3aad-4146-b2b8-97445cb26a11 already deleted. [ 654.633309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7280c70-3aad-4146-b2b8-97445cb26a11" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.655590] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.673960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 654.673960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.673960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.673960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.673960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.673960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.673960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.674675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.674675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.674675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.674675] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.762050] env[65231]: INFO networking_nsxv3.common.synchronization [req-6b33df24-11d1-4647-a659-0d934be3a874 req-9c9e6153-aadb-4e0c-b932-1026e9c335a5 tempest-ServerDiagnosticsNegativeTest-99429830 tempest-ServerDiagnosticsNegativeTest-99429830-project-member] Enqueued Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 654.762556] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 with Priority: HIGHEST for action security_group_members [ 654.763766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-089102e4-f74e-4139-88d6-a79e9f27e9c1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.763766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.763766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.763766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.763766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.763766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.764288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.764288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.764288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.764288] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089102e4-f74e-4139-88d6-a79e9f27e9c1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.158330] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.158485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.158559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.158789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.158882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.158980] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be updated. [ 655.177377] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.187113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.187255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.187318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.187521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.187659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.199933] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 655.266779] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.267022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.267022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.267232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.267331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.267529] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.267630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.267744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.267838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.267916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.268015] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 is going to be updated. [ 655.296038] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.296038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.296038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.296038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.296038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.304103] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: IN_PROGRESS for 2s [ 655.680299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c15aec1a-6b31-4260-9fa5-1dd741dd95c5: rpc.has_security_group_logging(os_id): False [ 655.700976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.701228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.701327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.701826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.702011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.702336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.702478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.702576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.702858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.703106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.703233] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be created. [ 655.782660] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.782947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.782947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.783207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.783435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.797721] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 656.358066] env[65231]: INFO networking_nsxv3.common.synchronization [req-2316806c-ec48-456b-b5ba-e790fd3e1e82 req-625fba0d-380d-417a-a7f5-28cfc3631769 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 656.358744] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 656.359072] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.359203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.359269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.359543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.359677] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.359774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.359774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.359892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.359974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.363109] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.379916] env[65231]: INFO networking_nsxv3.common.synchronization [req-2316806c-ec48-456b-b5ba-e790fd3e1e82 req-625fba0d-380d-417a-a7f5-28cfc3631769 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 656.379916] env[65231]: INFO networking_nsxv3.common.synchronization [req-2316806c-ec48-456b-b5ba-e790fd3e1e82 req-625fba0d-380d-417a-a7f5-28cfc3631769 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 656.380076] env[65231]: INFO networking_nsxv3.common.synchronization [req-2316806c-ec48-456b-b5ba-e790fd3e1e82 req-625fba0d-380d-417a-a7f5-28cfc3631769 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 656.380430] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 656.380788] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 656.380788] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 656.380913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.381013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.381084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.381300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.381513] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.382155] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.382242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.382424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-52ca75c9-0011-476a-9171-7109905cd39b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.382666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.382666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.382825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.382825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52ca75c9-0011-476a-9171-7109905cd39b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.866012] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.884061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.884218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.884390] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52ca75c9-0011-476a-9171-7109905cd39b with status ACTIVE [ 656.884556] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.884662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.884734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.884937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.885064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.885244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.885324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.885382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.885533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.885608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.885782] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.885872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.885931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.886092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.886169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.886252] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52ca75c9-0011-476a-9171-7109905cd39b is going to be updated. [ 656.911878] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.911878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.911878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.912080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.912223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.912379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.137930] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e3200c9d-e667-411e-86fb-05f8ce117261 None None] Enqueued Resource ID: 53398ac0-653c-4ed1-b9be-29651cc1508d with Priority: HIGHEST for action port [ 657.138641] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53398ac0-653c-4ed1-b9be-29651cc1508d with Priority: HIGHEST for action port [ 657.139854] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-53398ac0-653c-4ed1-b9be-29651cc1508d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.139854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53398ac0-653c-4ed1-b9be-29651cc1508d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.140018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53398ac0-653c-4ed1-b9be-29651cc1508d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.140408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53398ac0-653c-4ed1-b9be-29651cc1508d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.140408] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53398ac0-653c-4ed1-b9be-29651cc1508d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.214408] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 657.214631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.214803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.215036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.215318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.215478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.215567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.215754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.215863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.215974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.216106] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.260014] env[65231]: INFO networking_nsxv3.common.synchronization [req-23c634ad-deca-4aa4-80ab-9a9c0398c16f req-18c09782-1280-47a0-a058-3cbdb223000f tempest-ServerTagsTestJSON-86635438 tempest-ServerTagsTestJSON-86635438-project-member] Enqueued Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 657.260588] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGHEST for action security_group_members [ 657.260917] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.261412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.261526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.261804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.262052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.262225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.262329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.262558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.262797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.262887] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.314698] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 in Status: SUCCESS [ 657.315072] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089102e4-f74e-4139-88d6-a79e9f27e9c1 deletion is rescheduled due to dependency. [ 657.315363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089102e4-f74e-4139-88d6-a79e9f27e9c1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.367691] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.645239] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53398ac0-653c-4ed1-b9be-29651cc1508d [ 657.645239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.645239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.645239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.645239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.645239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.645239] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53398ac0-653c-4ed1-b9be-29651cc1508d already deleted. [ 657.645239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53398ac0-653c-4ed1-b9be-29651cc1508d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.719188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.719373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.719373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.719553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.719723] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.719839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.719920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.720090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.720363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.720479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.720644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.720749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.720811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.720972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.721231] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.721328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.721394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.721506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.721585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.721667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.721764] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.729016] env[65231]: INFO networking_nsxv3.common.synchronization [req-17a5bea5-258f-4af3-bf25-87ef6b7a8823 req-1dc4b987-2ed7-4e68-9dd0-bddb603d3c34 tempest-ServerDiagnosticsTest-531588960 tempest-ServerDiagnosticsTest-531588960-project-member] Enqueued Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 657.729609] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 657.729918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.730516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.730516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.730516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.733921] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.733921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.733921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.733921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.733921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.734965] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.767362] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.767544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.767544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.767669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.767774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.767979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.768138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.769390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.769390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.769390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.769390] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb is going to be updated. [ 657.800455] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.801693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.801693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.801693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.803585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.814228] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: IN_PROGRESS for 2s [ 657.817382] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 657.817614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.873868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.874253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.874253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.874409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.874409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.875040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 657.920463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.920682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.920729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.920918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.921380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.932279] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 658.225846] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da07af9e-2db7-465e-9508-0c4801123c21: rpc.has_security_group_logging(os_id): False [ 658.238891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.239150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.239237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.239500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.239602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.239852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.239992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.240091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.240282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.240550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.240550] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c already deleted. [ 658.240550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.258156] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.258387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.258446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.258648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.258738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.258965] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.259066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.260090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.260090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.260992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.260992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.261158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.261371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.261460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.261559] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be updated. [ 658.350871] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.351068] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.351190] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.351600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.353981] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.354258] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.354438] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.355018] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.355175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.355513] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.357335] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.357433] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.358267] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.358267] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.358267] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.358267] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.362689] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.362689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.362689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.362689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.363012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.385707] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 658.405561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.405561] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.405561] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.405561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405561] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.405561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.405561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.406312] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.406312] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.912877] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.913217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.913303] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.913673] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.913873] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.914055] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d not found, creating... [ 658.914358] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.914558] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.914672] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.914981] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.915120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.915835] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.915835] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.915835] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.916277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.916277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.916277] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d is going to be created. [ 658.937660] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.937959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.938068] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.938339] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.938604] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.938834] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.637935] env[65231]: INFO networking_nsxv3.common.synchronization [req-17a5bea5-258f-4af3-bf25-87ef6b7a8823 req-aa67453c-8809-432f-81f7-8258130deece service nova] Enqueued Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_rules [ 659.637935] env[65231]: INFO networking_nsxv3.common.synchronization [req-17a5bea5-258f-4af3-bf25-87ef6b7a8823 req-aa67453c-8809-432f-81f7-8258130deece service nova] Enqueued Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 659.637935] env[65231]: INFO networking_nsxv3.common.synchronization [req-17a5bea5-258f-4af3-bf25-87ef6b7a8823 req-aa67453c-8809-432f-81f7-8258130deece service nova] Enqueued Resource ID: bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d with Priority: HIGHEST for action port [ 659.638237] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_rules [ 659.638342] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 659.638437] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d with Priority: HIGHEST for action port [ 659.638942] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.638942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.638942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.639849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.639923] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.641615] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.641766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.641844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.642256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.642402] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.642517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.642576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.642712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.642796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.642890] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.644040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.644162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.644218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.644363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.644440] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.825850] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fbc0c08-a13f-4d85-8260-308f219683bb in Status: SUCCESS [ 659.825850] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb deletion is rescheduled due to dependency. [ 659.826138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.943709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 659.943709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.943709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944259] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.944596] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.146249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.146406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.146564] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.149398] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d with status ACTIVE [ 660.149398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.149398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.149398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.149398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.150404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.150493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.150628] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d is going to be updated. [ 660.174585] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.174785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.174859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.175100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.175245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.175408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf58e7c7-8b8e-4efd-ab98-7716c0dfe09d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.402352] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 660.402564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.446821] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.653155] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.746186] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ef300a4c-87fe-4263-b9ea-9d9dd9edb621 None None] Enqueued Resource ID: 997b9cc0-f38a-4404-a649-362f80c617ba with Priority: HIGHEST for action port [ 660.746186] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 997b9cc0-f38a-4404-a649-362f80c617ba with Priority: HIGHEST for action port [ 660.746186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-997b9cc0-f38a-4404-a649-362f80c617ba taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.746186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-997b9cc0-f38a-4404-a649-362f80c617ba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.746186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-997b9cc0-f38a-4404-a649-362f80c617ba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.746186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-997b9cc0-f38a-4404-a649-362f80c617ba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.746186] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('997b9cc0-f38a-4404-a649-362f80c617ba',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.949322] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.157130] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.157303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.157373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.157593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.157687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.157786] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c is going to be created. [ 661.183545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.183545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.183545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.183789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.183916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.195561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: UNINITIALIZED for 2s [ 661.248183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 997b9cc0-f38a-4404-a649-362f80c617ba [ 661.248459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.248564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.248625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.248840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.248946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.249084] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:997b9cc0-f38a-4404-a649-362f80c617ba already deleted. [ 661.249265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-997b9cc0-f38a-4404-a649-362f80c617ba" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453978] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.454171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.454250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.454462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.454555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.454655] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 661.498955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.498955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.498955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.504146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.504146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511222] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 662.068040] env[65231]: INFO networking_nsxv3.common.synchronization [req-ceff1c09-561e-43fb-9055-9c396eb101b3 req-70f950ba-1249-4775-8cfd-8aa0693c0859 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: 705cae12-3fc4-4e59-99ac-93f7d8d5a44f with Priority: HIGHEST for action security_group_rules [ 662.068919] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705cae12-3fc4-4e59-99ac-93f7d8d5a44f with Priority: HIGHEST for action security_group_rules [ 662.069344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-705cae12-3fc4-4e59-99ac-93f7d8d5a44f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.069508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-705cae12-3fc4-4e59-99ac-93f7d8d5a44f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.069593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-705cae12-3fc4-4e59-99ac-93f7d8d5a44f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.070055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-705cae12-3fc4-4e59-99ac-93f7d8d5a44f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.070055] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('705cae12-3fc4-4e59-99ac-93f7d8d5a44f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.187918] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ac4cc1c4-c4c3-43f1-80c0-b0265c451de2 None None] Enqueued Resource ID: 48d4611a-9ce4-4720-a90c-91753459026b with Priority: HIGHEST for action port [ 662.188528] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d4611a-9ce4-4720-a90c-91753459026b with Priority: HIGHEST for action port [ 662.188876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-48d4611a-9ce4-4720-a90c-91753459026b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.189049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48d4611a-9ce4-4720-a90c-91753459026b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.189123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48d4611a-9ce4-4720-a90c-91753459026b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.189742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48d4611a-9ce4-4720-a90c-91753459026b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.189742] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d4611a-9ce4-4720-a90c-91753459026b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.199977] env[65231]: INFO networking_nsxv3.common.synchronization [req-172e9838-276c-4bae-a1d7-18d2386a69bb req-c0266bd4-aa46-4712-9d98-2839901e9ceb tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 662.200589] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 662.200904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.201180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.201318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.201679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.201994] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.202211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.202321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.202569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.202727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.202870] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.595070] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.595251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.595348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.595585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.595674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.595768] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 705cae12-3fc4-4e59-99ac-93f7d8d5a44f already deleted. [ 662.595849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-705cae12-3fc4-4e59-99ac-93f7d8d5a44f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.695023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48d4611a-9ce4-4720-a90c-91753459026b [ 662.695023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.695023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.695023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.695023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.695023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.695023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48d4611a-9ce4-4720-a90c-91753459026b already deleted. [ 662.695023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48d4611a-9ce4-4720-a90c-91753459026b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.705143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.705953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.705953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.705953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.705953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.705953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.705953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.706223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.706223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.706298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.706338] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf already deleted. [ 662.707077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.841138] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.841138] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.841138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.841138] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.841138] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.841138] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.841138] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.841735] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.841735] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.841735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.869972] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.871211] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.871386] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.871644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.871893] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.872318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.872495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.872860] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.873202] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cd27e4a-a234-49e1-b494-b02d19bf7cf9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.210665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: SUCCESS [ 663.210908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.211094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.211541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.211541] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.211688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.211688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.211836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.211886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.211969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.212097] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.296796] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c2ad5bb1-9d64-4d46-9ef2-c69324666b64 None None] Enqueued Resource ID: d61dc747-b762-41df-aad8-fcfdc796fa06 with Priority: HIGHEST for action port [ 663.297061] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d61dc747-b762-41df-aad8-fcfdc796fa06 with Priority: HIGHEST for action port [ 663.297635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d61dc747-b762-41df-aad8-fcfdc796fa06 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.297802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d61dc747-b762-41df-aad8-fcfdc796fa06" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.297942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d61dc747-b762-41df-aad8-fcfdc796fa06" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.298630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d61dc747-b762-41df-aad8-fcfdc796fa06" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.298678] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61dc747-b762-41df-aad8-fcfdc796fa06',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.376753] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.379804] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 not found, creating... [ 663.379804] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.379804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.380425] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.380425] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.380842] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.380985] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.381507] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.381507] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 is going to be created. [ 663.403744] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.403744] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.403744] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.403979] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.404711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.405077] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.522964] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 663.523211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.523756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.523967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.524571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.524571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.524571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.524571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.524571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.524930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.524930] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.716228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.716228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.716228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.716228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.716228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.716228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.716228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.716661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.716661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.716661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.717666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.717666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.717781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.718344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.718344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.718344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.718344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.718815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.719226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.719926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.720052] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.800803] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d61dc747-b762-41df-aad8-fcfdc796fa06 [ 663.801127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.801720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.801820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.802091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.802186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.802355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d61dc747-b762-41df-aad8-fcfdc796fa06 already deleted. [ 663.802449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d61dc747-b762-41df-aad8-fcfdc796fa06" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.027289] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.223112] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bcea4e4-2c8c-4878-89e4-515969ca794c: rpc.has_security_group_logging(os_id): False [ 664.244160] env[65231]: INFO networking_nsxv3.common.synchronization [req-172e9838-276c-4bae-a1d7-18d2386a69bb req-bdc85816-1c7b-4c2a-a23b-01852fd67874 service nova] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 664.244424] env[65231]: INFO networking_nsxv3.common.synchronization [req-172e9838-276c-4bae-a1d7-18d2386a69bb req-bdc85816-1c7b-4c2a-a23b-01852fd67874 service nova] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 664.244687] env[65231]: INFO networking_nsxv3.common.synchronization [req-172e9838-276c-4bae-a1d7-18d2386a69bb req-bdc85816-1c7b-4c2a-a23b-01852fd67874 service nova] Enqueued Resource ID: 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 with Priority: HIGHEST for action port [ 664.245263] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_rules [ 664.245516] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 664.245561] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 with Priority: HIGHEST for action port [ 664.245912] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.246124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.246197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.246399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.246517] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.247799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.249288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.249288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.249288] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.250740] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.250898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.251052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.251619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.251619] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cd27e4a-a234-49e1-b494-b02d19bf7cf9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.259540] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.259690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.259745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.259976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.260443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.260443] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.260443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.260687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.260687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.260769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.261382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.261382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.261382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.261382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.261382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.262152] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.262152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.262152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.262152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.262152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.262152] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c is going to be created. [ 664.396027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.396027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.396027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.396027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.396027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.413159] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: IN_PROGRESS for 2s [ 664.463892] env[65231]: INFO networking_nsxv3.common.synchronization [req-8190e161-dee0-49a5-8650-728004757123 req-ee1e617c-9bfb-42c4-9dd5-3f64acf97807 tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 664.464305] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 664.464623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.464746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.464811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.466654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.466881] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.467025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.467083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.467289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.467388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.467492] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.531735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdb04723-8209-4d79-9e38-c5a195883f28: rpc.has_security_group_logging(os_id): False [ 664.552047] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.552282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.552282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.552552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.552731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.553032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.553164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.553226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.553506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.553602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.553702] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 664.655828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.656049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.656124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.656296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.656584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.670775] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 664.753468] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.756613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.756613] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 with status ACTIVE [ 664.756613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.756613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.756613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.756613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.757323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.757543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.757804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.757995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.759885] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cd27e4a-a234-49e1-b494-b02d19bf7cf9 is going to be updated. [ 664.789797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.790420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.790634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.790997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.791339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.791700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cd27e4a-a234-49e1-b494-b02d19bf7cf9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.915872] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.916591] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.916591] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.916591] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.916816] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.916967] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.917085] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.917658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.917658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.917658] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.917944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.917944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.918070] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.918123] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.918226] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.918371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.948208] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.948392] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.948512] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.948727] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.949024] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.949189] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.949303] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.949691] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.949842] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1dfb391-2f0b-4fa1-ad26-e7589d96f88b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.969703] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.969943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.970068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.970432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.970601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.970932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.971113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.971194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.971397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.971473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.971561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 already deleted. [ 664.971638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.260168] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.452585] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.453131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.453529] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.453827] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.453987] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.454211] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port f1dfb391-2f0b-4fa1-ad26-e7589d96f88b not found, creating... [ 665.454570] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.454760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.454875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.455393] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.455565] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.455941] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.456122] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.456233] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.456449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.456579] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.456736] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: f1dfb391-2f0b-4fa1-ad26-e7589d96f88b is going to be created. [ 665.483064] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.483332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.483385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.483651] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.483879] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.484109] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.763153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.763336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.763409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.763652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.763730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.763943] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf is going to be created. [ 665.788370] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.788606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.788606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.788867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.789053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.798651] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: UNINITIALIZED for 2s [ 666.219480] env[65231]: INFO networking_nsxv3.common.synchronization [req-8190e161-dee0-49a5-8650-728004757123 req-2cd3cdd8-f812-47ba-9fbe-4aff33273d38 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 666.219480] env[65231]: INFO networking_nsxv3.common.synchronization [req-8190e161-dee0-49a5-8650-728004757123 req-2cd3cdd8-f812-47ba-9fbe-4aff33273d38 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 666.219792] env[65231]: INFO networking_nsxv3.common.synchronization [req-8190e161-dee0-49a5-8650-728004757123 req-2cd3cdd8-f812-47ba-9fbe-4aff33273d38 service nova] Enqueued Resource ID: f1dfb391-2f0b-4fa1-ad26-e7589d96f88b with Priority: HIGHEST for action port [ 666.220395] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 666.220497] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 666.220570] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1dfb391-2f0b-4fa1-ad26-e7589d96f88b with Priority: HIGHEST for action port [ 666.220801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.221499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.221632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.224500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.224626] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.225509] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.225632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.225700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.225879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.226045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.226147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.226205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.226351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.226436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.226524] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.232060] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.232060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.232060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.232060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.232060] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1dfb391-2f0b-4fa1-ad26-e7589d96f88b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.343074] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2ddf0da5-e35b-42ce-926b-a826a3189b5d None None] Enqueued Resource ID: 452cf59b-c49d-46bd-923d-662a9b4b189c with Priority: HIGHEST for action port [ 666.343361] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 452cf59b-c49d-46bd-923d-662a9b4b189c with Priority: HIGHEST for action port [ 666.344030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-452cf59b-c49d-46bd-923d-662a9b4b189c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.344030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-452cf59b-c49d-46bd-923d-662a9b4b189c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.344418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-452cf59b-c49d-46bd-923d-662a9b4b189c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.344418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-452cf59b-c49d-46bd-923d-662a9b4b189c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.344537] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('452cf59b-c49d-46bd-923d-662a9b4b189c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.433407] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: SUCCESS [ 666.433536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.655079] env[65231]: INFO networking_nsxv3.common.synchronization [req-848a822b-ebc1-4809-8242-e8d5a67ce9cb req-a5459c60-047c-49c0-9d5e-6232bd8aaade tempest-DeleteServersAdminTestJSON-1674141270 tempest-DeleteServersAdminTestJSON-1674141270-project-member] Enqueued Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 666.655079] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 with Priority: HIGHEST for action security_group_members [ 666.655079] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.655079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.655079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.655358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.655396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.655536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.655613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.655724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.655823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.655895] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4dd131-77b2-4914-aa5f-9f4b5de030a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.693809] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 666.693809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.732042] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.735045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.735045] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1dfb391-2f0b-4fa1-ad26-e7589d96f88b with status ACTIVE [ 666.735045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.735045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.735045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.735962] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.735962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.736216] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1dfb391-2f0b-4fa1-ad26-e7589d96f88b is going to be updated. [ 666.773712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.773712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.773712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.773712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.773712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.773712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1dfb391-2f0b-4fa1-ad26-e7589d96f88b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.846364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 452cf59b-c49d-46bd-923d-662a9b4b189c [ 666.846648] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.847795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.847795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.847795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.847795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.847795] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:452cf59b-c49d-46bd-923d-662a9b4b189c already deleted. [ 666.847795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-452cf59b-c49d-46bd-923d-662a9b4b189c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.038567] env[65231]: INFO networking_nsxv3.common.synchronization [None req-93081635-1d54-4fe3-bddc-8ef7feb1d231 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 667.039271] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 667.039599] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.039717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.039794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.040072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.040185] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.158732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.160190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.160311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.160918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.160918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.160918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.161151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.161151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.161247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.161309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.161468] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 is going to be updated. [ 667.194626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.194805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.194854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.195347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.195509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.206797] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: IN_PROGRESS for 2s [ 667.229300] env[65231]: INFO networking_nsxv3.common.synchronization [None req-649f0653-0172-4801-937f-a1c347f0da8d tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 667.229300] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 667.229300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.229300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.238224] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.529450] env[65231]: INFO networking_nsxv3.common.synchronization [req-b0fa4502-6ed2-42c4-8288-285940c0ce54 req-3b1bb006-a8e0-431d-8130-a658dc365326 tempest-ServerGroupTestJSON-1782751920 tempest-ServerGroupTestJSON-1782751920-project-member] Enqueued Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 667.530103] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 667.530492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.530656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.530656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.530965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.531592] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.531710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.531765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.532023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.532023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.532127] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.565131] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.565302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.565414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.565698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.565816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.565951] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 already deleted. [ 667.566061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.566579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.566743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.566822] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.740951] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.741153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.741270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.741556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.741675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.741802] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be created. [ 667.781959] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.784590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.784590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.784590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.784590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.800981] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: UNINITIALIZED for 2s [ 667.815092] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: SUCCESS [ 667.815487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.815684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.816463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.817469] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.817469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.817469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.817469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.817469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.817469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.817469] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.035140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.035401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.035401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.035575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.035657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.035889] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.035999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.036062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.036314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.036395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.036504] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 already deleted. [ 668.036937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.090428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.090428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.090902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.090902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.091047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.091747] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 already deleted. [ 668.091843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.129523] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-876" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-876" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-876" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.129523] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.129523] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.129523] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.129523] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.129523] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.129523] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.131477] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.131477] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.131477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.135495] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.135495] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.135495] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.135495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-876" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.135495] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-56377023-ef4f-4c70-9503-1708d2fd9962 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.135495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.135495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.135495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.135495] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56377023-ef4f-4c70-9503-1708d2fd9962',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.319235] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.640318] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.640318] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 56377023-ef4f-4c70-9503-1708d2fd9962 not found, creating... [ 668.640318] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.640318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.641078] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.641078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.641317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.641648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.641944] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.642179] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 56377023-ef4f-4c70-9503-1708d2fd9962 is going to be created. [ 668.664294] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.664294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.664294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.664294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.664294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.664589] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.821920] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf: rpc.has_security_group_logging(os_id): False [ 668.857517] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.859684] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.859684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.859684] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf is going to be created. [ 668.960478] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.963020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.963020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.963020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.963020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.977682] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: IN_PROGRESS for 2s [ 669.148970] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2cf861d4-3e5f-4745-a3cb-4bf9dc712046 None None] Enqueued Resource ID: b8617865-e301-4e3c-acee-85d9ec782fca with Priority: HIGHEST for action port [ 669.150355] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8617865-e301-4e3c-acee-85d9ec782fca with Priority: HIGHEST for action port [ 669.150355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8617865-e301-4e3c-acee-85d9ec782fca taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.150355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8617865-e301-4e3c-acee-85d9ec782fca" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.150355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8617865-e301-4e3c-acee-85d9ec782fca" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.150504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8617865-e301-4e3c-acee-85d9ec782fca" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.150504] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8617865-e301-4e3c-acee-85d9ec782fca',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.246996] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 in Status: SUCCESS [ 669.247984] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4dd131-77b2-4914-aa5f-9f4b5de030a2 deletion is rescheduled due to dependency. [ 669.247984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4dd131-77b2-4914-aa5f-9f4b5de030a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.451750] env[65231]: INFO networking_nsxv3.common.synchronization [req-b0fa4502-6ed2-42c4-8288-285940c0ce54 req-bdcc49f5-c60d-4051-9350-f6f5c2b92f90 service nova] Enqueued Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_rules [ 669.451750] env[65231]: INFO networking_nsxv3.common.synchronization [req-b0fa4502-6ed2-42c4-8288-285940c0ce54 req-bdcc49f5-c60d-4051-9350-f6f5c2b92f90 service nova] Enqueued Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 669.451880] env[65231]: INFO networking_nsxv3.common.synchronization [req-b0fa4502-6ed2-42c4-8288-285940c0ce54 req-bdcc49f5-c60d-4051-9350-f6f5c2b92f90 service nova] Enqueued Resource ID: 56377023-ef4f-4c70-9503-1708d2fd9962 with Priority: HIGHEST for action port [ 669.452566] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_rules [ 669.452708] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 669.452807] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56377023-ef4f-4c70-9503-1708d2fd9962 with Priority: HIGHEST for action port [ 669.453605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.453786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.453877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.454171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.454289] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.455246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.455655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.455790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.458069] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.458069] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.458069] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-56377023-ef4f-4c70-9503-1708d2fd9962 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.458069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.458069] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56377023-ef4f-4c70-9503-1708d2fd9962',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.652619] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8617865-e301-4e3c-acee-85d9ec782fca [ 669.653060] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.653441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.653441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.653707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.653806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.653899] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8617865-e301-4e3c-acee-85d9ec782fca already deleted. [ 669.653998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8617865-e301-4e3c-acee-85d9ec782fca" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.811849] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 669.812081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.812259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.812574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.812832] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.812964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.813040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.813242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.813330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.813464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.813618] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.961801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.961956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.962431] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.963400] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56377023-ef4f-4c70-9503-1708d2fd9962 with status ACTIVE [ 669.963676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.963858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.963966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.964291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.964461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.964742] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.964912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.966033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.966289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.966427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.966688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.966823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.966918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.967141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.967310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.967464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56377023-ef4f-4c70-9503-1708d2fd9962 is going to be updated. [ 669.993713] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.993713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.993713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.993713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.993713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.993713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56377023-ef4f-4c70-9503-1708d2fd9962" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.321028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.321661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321661] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.471989] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.826035] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93d71ddd-aafd-4027-b22a-d8863fc345e7: rpc.has_security_group_logging(os_id): False [ 670.847269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.847497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.847497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.848098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.848098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.848098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.848098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.848098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.848289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.848314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.848813] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.848813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.848813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.848813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.848971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.849062] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.849153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.849213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.849348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.849420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.849503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be created. [ 670.917744] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.917928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.917969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.918192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.918383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.980022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.980022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.980022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.980022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.980022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.980022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 is going to be created. [ 671.016659] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 671.018051] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: SUCCESS [ 671.018320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.044200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.044409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.044483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.044701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.044859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.070461] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: UNINITIALIZED for 2s [ 671.762516] env[65231]: INFO networking_nsxv3.common.synchronization [None req-03687ad7-f6d5-45d7-b1ae-4352883214a3 None None] Enqueued Resource ID: 6b633f86-35db-4c78-a9b2-6b4ed01569c0 with Priority: HIGHEST for action port [ 671.763130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b633f86-35db-4c78-a9b2-6b4ed01569c0 with Priority: HIGHEST for action port [ 671.763443] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b633f86-35db-4c78-a9b2-6b4ed01569c0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.763567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b633f86-35db-4c78-a9b2-6b4ed01569c0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.763654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b633f86-35db-4c78-a9b2-6b4ed01569c0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.763893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b633f86-35db-4c78-a9b2-6b4ed01569c0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.763975] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b633f86-35db-4c78-a9b2-6b4ed01569c0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.268709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b633f86-35db-4c78-a9b2-6b4ed01569c0 [ 672.268997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.269103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.269158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.270134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.270134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.270134] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b633f86-35db-4c78-a9b2-6b4ed01569c0 already deleted. [ 672.270709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b633f86-35db-4c78-a9b2-6b4ed01569c0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.495691] env[65231]: INFO networking_nsxv3.common.synchronization [req-04f3ce24-b234-4f15-b2d9-d87981d0bf54 req-402dda17-fb31-4053-820a-86b46e6e104e tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 672.497039] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 672.497039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.497207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.497239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.497484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.497731] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.497857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.497941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.498120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.498243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.498299] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.511427] env[65231]: INFO networking_nsxv3.common.synchronization [req-04f3ce24-b234-4f15-b2d9-d87981d0bf54 req-402dda17-fb31-4053-820a-86b46e6e104e tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 672.511597] env[65231]: INFO networking_nsxv3.common.synchronization [req-04f3ce24-b234-4f15-b2d9-d87981d0bf54 req-402dda17-fb31-4053-820a-86b46e6e104e tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 672.511749] env[65231]: INFO networking_nsxv3.common.synchronization [req-04f3ce24-b234-4f15-b2d9-d87981d0bf54 req-402dda17-fb31-4053-820a-86b46e6e104e tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 672.512596] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_rules [ 672.512768] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 672.513120] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52ca75c9-0011-476a-9171-7109905cd39b with Priority: HIGHEST for action port [ 672.514026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.514304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.514414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.514646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.514799] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.515872] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.517143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.517143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-52ca75c9-0011-476a-9171-7109905cd39b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.517143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.517143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.517143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.517143] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52ca75c9-0011-476a-9171-7109905cd39b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.862890] env[65231]: INFO networking_nsxv3.common.synchronization [req-8460c515-490c-4624-8ce2-41fe934ec8db req-95927854-47f1-463e-840c-79f7690e6d5a tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: 2e0b5a0e-afd7-46bb-b1b6-777c55695bab with Priority: HIGHEST for action security_group_rules [ 672.863505] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0b5a0e-afd7-46bb-b1b6-777c55695bab with Priority: HIGHEST for action security_group_rules [ 672.864474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0b5a0e-afd7-46bb-b1b6-777c55695bab taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.864474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0b5a0e-afd7-46bb-b1b6-777c55695bab" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.864474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0b5a0e-afd7-46bb-b1b6-777c55695bab" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.864474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0b5a0e-afd7-46bb-b1b6-777c55695bab" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.864474] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0b5a0e-afd7-46bb-b1b6-777c55695bab',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.001942] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.021025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.021025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.021025] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52ca75c9-0011-476a-9171-7109905cd39b with status ACTIVE [ 673.021025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.021025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.021025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.021025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.021025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.021025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.021616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.021774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.022029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.022199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.022463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.022690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.022830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.023066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.023228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.023422] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52ca75c9-0011-476a-9171-7109905cd39b is going to be updated. [ 673.036732] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 673.036732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.052527] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.052527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.052527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.052527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.052527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.052527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52ca75c9-0011-476a-9171-7109905cd39b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.082738] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: SUCCESS [ 673.082966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.083149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.084374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.084374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.084374] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.387870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.388210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.388210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.388524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.388524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.388634] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0b5a0e-afd7-46bb-b1b6-777c55695bab already deleted. [ 673.388753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0b5a0e-afd7-46bb-b1b6-777c55695bab" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.504919] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.588520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.588520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.588520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.588520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.588520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.588807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.588807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.588807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.588935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.589020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.589156] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.589256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.589319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.589462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.589614] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.589722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.589782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.589928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.591294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.591294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.591294] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.008252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.008451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.008554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.008817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.008902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.009044] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 674.051793] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.051793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.051793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.051793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.051793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.066409] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 674.092956] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 891aab68-a374-48cb-ac40-546cb8e3fe02: rpc.has_security_group_logging(os_id): False [ 674.117336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.117476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.117594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.117767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.117872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.118100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.118187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.118253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.118574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.118574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.118706] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.118810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.118982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.119046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.119078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.119479] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.119479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.119479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.119637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.119669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.119858] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 is going to be created. [ 674.248576] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.248845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.248958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.249308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.250235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.273422] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: IN_PROGRESS for 2s [ 675.263391] env[65231]: INFO networking_nsxv3.common.synchronization [None req-5d9ea069-cbe0-42c3-8158-cbb129397c17 None None] Enqueued Resource ID: 1ef020a6-b97f-48d7-b238-44831bf18cc9 with Priority: HIGHEST for action port [ 675.263665] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ef020a6-b97f-48d7-b238-44831bf18cc9 with Priority: HIGHEST for action port [ 675.265114] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ef020a6-b97f-48d7-b238-44831bf18cc9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.265114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ef020a6-b97f-48d7-b238-44831bf18cc9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.265114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ef020a6-b97f-48d7-b238-44831bf18cc9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.265114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ef020a6-b97f-48d7-b238-44831bf18cc9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.265114] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ef020a6-b97f-48d7-b238-44831bf18cc9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.598295] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b1d393b1-bc3a-41f3-b787-ca451b13c378 None None] Enqueued Resource ID: 2d457f56-b28b-4207-b826-f82146500bdc with Priority: HIGHEST for action port [ 675.600428] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d457f56-b28b-4207-b826-f82146500bdc with Priority: HIGHEST for action port [ 675.600807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d457f56-b28b-4207-b826-f82146500bdc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.600966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d457f56-b28b-4207-b826-f82146500bdc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.601063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d457f56-b28b-4207-b826-f82146500bdc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.601375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d457f56-b28b-4207-b826-f82146500bdc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.601458] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d457f56-b28b-4207-b826-f82146500bdc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.661129] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0462f202-93a0-4344-8ef3-c68dff54d98e tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 675.661129] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 675.661129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.663568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.663568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.663568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.663568] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.770024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ef020a6-b97f-48d7-b238-44831bf18cc9 [ 675.770024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.770024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.770024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.770024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.770024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.770024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ef020a6-b97f-48d7-b238-44831bf18cc9 already deleted. [ 675.770024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ef020a6-b97f-48d7-b238-44831bf18cc9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.969588] env[65231]: INFO networking_nsxv3.common.synchronization [None req-4fc84454-554c-4066-9c1a-a0d69054c185 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 675.970539] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 675.970956] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.971917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.081575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 676.081902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.082161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.082358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.082558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.082718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.082798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.083011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.083087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.083132] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.103448] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d457f56-b28b-4207-b826-f82146500bdc [ 676.106747] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.107123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.107123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.107305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.107429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.107725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d457f56-b28b-4207-b826-f82146500bdc already deleted. [ 676.107725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d457f56-b28b-4207-b826-f82146500bdc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.188334] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.188533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.188603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.189052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.189168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.189271] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 already deleted. [ 676.189390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.189607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.189806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.189890] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.292135] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: SUCCESS [ 676.292375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.585892] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.711988] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.712191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.712264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.713049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.713049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.714200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 already deleted. [ 676.714305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.088782] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.320349] env[65231]: INFO networking_nsxv3.common.synchronization [req-d3fb6d69-fe77-4a29-b30e-6c54d5ad12a8 req-04e4b514-0640-4049-9e1e-62c7e392e101 tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 677.321476] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 677.321553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.321638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.321673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.321883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.322045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.322144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.322206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.322366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.323082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.323082] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.578966] env[65231]: INFO networking_nsxv3.common.synchronization [None req-25fdd8a5-5d66-4f52-bb02-87fb17383c87 None None] Enqueued Resource ID: cc3e1a65-316c-48ca-9f96-3d08b24c0a99 with Priority: HIGHEST for action port [ 677.579665] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3e1a65-316c-48ca-9f96-3d08b24c0a99 with Priority: HIGHEST for action port [ 677.579993] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc3e1a65-316c-48ca-9f96-3d08b24c0a99 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.580133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc3e1a65-316c-48ca-9f96-3d08b24c0a99" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.580245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc3e1a65-316c-48ca-9f96-3d08b24c0a99" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.580866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc3e1a65-316c-48ca-9f96-3d08b24c0a99" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.581324] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc3e1a65-316c-48ca-9f96-3d08b24c0a99',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.591069] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.591069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.591254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.591441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.591502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.591565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 677.629774] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.629998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.629998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.630224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.630428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.643142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 677.718132] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ceb26463-78a8-447b-9807-c6b46a7baa46 None None] Enqueued Resource ID: c13152f8-9810-4298-9640-8483a814f1ef with Priority: HIGHEST for action port [ 677.719761] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c13152f8-9810-4298-9640-8483a814f1ef with Priority: HIGHEST for action port [ 677.720879] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c13152f8-9810-4298-9640-8483a814f1ef taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.721023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c13152f8-9810-4298-9640-8483a814f1ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.721088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c13152f8-9810-4298-9640-8483a814f1ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.721397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c13152f8-9810-4298-9640-8483a814f1ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.721467] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13152f8-9810-4298-9640-8483a814f1ef',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.827329] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.086203] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc3e1a65-316c-48ca-9f96-3d08b24c0a99 [ 678.086203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.086203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.086203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.086203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.086203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.086203] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc3e1a65-316c-48ca-9f96-3d08b24c0a99 already deleted. [ 678.086203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc3e1a65-316c-48ca-9f96-3d08b24c0a99" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.207080] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.207080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.207080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.207080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.207080] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.207080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.207641] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.207973] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.208241] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.208605] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.208809] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.208992] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.209187] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.209383] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.209563] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.209786] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.228318] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c13152f8-9810-4298-9640-8483a814f1ef [ 678.228318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.228318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.228318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.228318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.228318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.228318] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c13152f8-9810-4298-9640-8483a814f1ef already deleted. [ 678.228318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c13152f8-9810-4298-9640-8483a814f1ef" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.236643] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.238039] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.238039] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.238039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.238039] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-433e0256-aaf5-4599-a5ea-3fcdcddca388 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.238039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.238039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.238444] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.238494] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('433e0256-aaf5-4599-a5ea-3fcdcddca388',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.331359] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.694898] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9c9c92ff-2967-4bf2-819b-a72a1fcd5fe4 None None] Enqueued Resource ID: 55e262ce-57ee-407d-9adc-38feeda056d0 with Priority: HIGHEST for action port [ 678.697255] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e262ce-57ee-407d-9adc-38feeda056d0 with Priority: HIGHEST for action port [ 678.697255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-55e262ce-57ee-407d-9adc-38feeda056d0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.697255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55e262ce-57ee-407d-9adc-38feeda056d0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.697255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55e262ce-57ee-407d-9adc-38feeda056d0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.697255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55e262ce-57ee-407d-9adc-38feeda056d0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.697255] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55e262ce-57ee-407d-9adc-38feeda056d0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.742324] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.742533] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.742650] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.742928] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.743086] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.743236] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 433e0256-aaf5-4599-a5ea-3fcdcddca388 not found, creating... [ 678.743479] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.743629] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.743738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.743943] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.744106] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.744434] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.744590] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.744700] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.744898] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.745150] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.745351] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 433e0256-aaf5-4599-a5ea-3fcdcddca388 is going to be created. [ 678.767583] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.767583] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.767583] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.767784] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.767962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.768193] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.833617] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.834927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.834927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.834927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.834927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.834927] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 678.866605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.867511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.867511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.867511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.867511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.892700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 679.199277] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55e262ce-57ee-407d-9adc-38feeda056d0 [ 679.199277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.199277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.199277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.199658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.199658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.199658] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55e262ce-57ee-407d-9adc-38feeda056d0 already deleted. [ 679.199759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55e262ce-57ee-407d-9adc-38feeda056d0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.505294] env[65231]: INFO networking_nsxv3.common.synchronization [None req-81d7c6ee-6b9a-4cce-851c-e75f160117b7 None None] Enqueued Resource ID: 77721d88-eee7-4bf9-b113-ec71a776ffb4 with Priority: HIGHEST for action port [ 679.506257] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77721d88-eee7-4bf9-b113-ec71a776ffb4 with Priority: HIGHEST for action port [ 679.507227] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-77721d88-eee7-4bf9-b113-ec71a776ffb4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.507503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77721d88-eee7-4bf9-b113-ec71a776ffb4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.507633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77721d88-eee7-4bf9-b113-ec71a776ffb4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.507983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77721d88-eee7-4bf9-b113-ec71a776ffb4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.508161] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77721d88-eee7-4bf9-b113-ec71a776ffb4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.574282] env[65231]: INFO networking_nsxv3.common.synchronization [req-d3fb6d69-fe77-4a29-b30e-6c54d5ad12a8 req-2b93f5bf-07e3-4897-a9a8-55fa0c24a07c service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 679.574282] env[65231]: INFO networking_nsxv3.common.synchronization [req-d3fb6d69-fe77-4a29-b30e-6c54d5ad12a8 req-2b93f5bf-07e3-4897-a9a8-55fa0c24a07c service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 679.574282] env[65231]: INFO networking_nsxv3.common.synchronization [req-d3fb6d69-fe77-4a29-b30e-6c54d5ad12a8 req-2b93f5bf-07e3-4897-a9a8-55fa0c24a07c service nova] Enqueued Resource ID: 433e0256-aaf5-4599-a5ea-3fcdcddca388 with Priority: HIGHEST for action port [ 679.574520] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 679.574652] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 679.574739] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433e0256-aaf5-4599-a5ea-3fcdcddca388 with Priority: HIGHEST for action port [ 679.576782] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.576884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.576956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.577156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.577581] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.579144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.579144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.579144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-433e0256-aaf5-4599-a5ea-3fcdcddca388 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.579144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.579425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.579425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.579425] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('433e0256-aaf5-4599-a5ea-3fcdcddca388',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.655208] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 679.655371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.655798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.656475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.656475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.656475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.656475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.656737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.656737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.656737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.656830] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.010725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77721d88-eee7-4bf9-b113-ec71a776ffb4 [ 680.011407] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.011407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.011407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.011627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.011627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.011627] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77721d88-eee7-4bf9-b113-ec71a776ffb4 already deleted. [ 680.011704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77721d88-eee7-4bf9-b113-ec71a776ffb4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.082132] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.082132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.082385] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 433e0256-aaf5-4599-a5ea-3fcdcddca388 with status ACTIVE [ 680.082416] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.082520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.082566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.082886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.082886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.083049] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.083170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.083170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.083315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.083507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.083566] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.083654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.084094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.084094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.084094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.084094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 433e0256-aaf5-4599-a5ea-3fcdcddca388 is going to be updated. [ 680.107480] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.107626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.107663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.107852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.107988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.108157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-433e0256-aaf5-4599-a5ea-3fcdcddca388" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.158763] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.664978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdb04723-8209-4d79-9e38-c5a195883f28: rpc.has_security_group_logging(os_id): False [ 680.682626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.682794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.682834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.683395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.683395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.683481] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.683533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.683573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.684641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.684641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.684641] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 680.759468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.759827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.759945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.760235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.760479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.776949] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 680.905718] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 680.905922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.906111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.906320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.906504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.906610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.906670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.906814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.906889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.906978] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.411074] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.507556] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b1fb54d6-2542-4aa0-a17c-5b96d9cd81d8 None None] Enqueued Resource ID: 60b62c7c-c07a-4c60-b9ce-1c0b35af6b77 with Priority: HIGHEST for action port [ 681.508183] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b62c7c-c07a-4c60-b9ce-1c0b35af6b77 with Priority: HIGHEST for action port [ 681.508537] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b62c7c-c07a-4c60-b9ce-1c0b35af6b77 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.508721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b62c7c-c07a-4c60-b9ce-1c0b35af6b77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.508792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b62c7c-c07a-4c60-b9ce-1c0b35af6b77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.509056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b62c7c-c07a-4c60-b9ce-1c0b35af6b77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.509139] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b62c7c-c07a-4c60-b9ce-1c0b35af6b77',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.768899] env[65231]: INFO networking_nsxv3.common.synchronization [None req-8e321ec6-8b4e-44c3-8a5f-f42e03e1e1ae None None] Enqueued Resource ID: 91c8c367-1cac-4f9b-ade2-3a07fe5466c2 with Priority: HIGHEST for action port [ 681.770489] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91c8c367-1cac-4f9b-ade2-3a07fe5466c2 with Priority: HIGHEST for action port [ 681.770886] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-91c8c367-1cac-4f9b-ade2-3a07fe5466c2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.771330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91c8c367-1cac-4f9b-ade2-3a07fe5466c2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.771401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91c8c367-1cac-4f9b-ade2-3a07fe5466c2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.771663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91c8c367-1cac-4f9b-ade2-3a07fe5466c2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.771767] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91c8c367-1cac-4f9b-ade2-3a07fe5466c2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.914124] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.013510] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60b62c7c-c07a-4c60-b9ce-1c0b35af6b77 [ 682.013721] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.017231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.017231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.017231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.017231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.017231] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60b62c7c-c07a-4c60-b9ce-1c0b35af6b77 already deleted. [ 682.017231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b62c7c-c07a-4c60-b9ce-1c0b35af6b77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.030484] env[65231]: INFO networking_nsxv3.common.synchronization [req-d22032ea-b932-4d35-9306-4b17e45662fd req-b54e0795-5f22-409c-b041-f4e9d0b50a81 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 682.030973] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 682.031577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.031926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.031926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.032150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.032355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.034119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.034119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.034119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.034119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.034119] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.275181] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91c8c367-1cac-4f9b-ade2-3a07fe5466c2 [ 682.275414] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.275573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.275623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.276238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.276238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.276347] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91c8c367-1cac-4f9b-ade2-3a07fe5466c2 already deleted. [ 682.276347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91c8c367-1cac-4f9b-ade2-3a07fe5466c2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.420211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.420528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.420844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.420844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.420919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.421176] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 682.456942] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.456942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.457142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.457231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.457333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.470205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 682.530082] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-426 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.530297] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.530455] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.530788] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.531123] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.531307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.532463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.532463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.532463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.532463] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.532463] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.532463] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.532463] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.532734] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.532734] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.532734] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.537678] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.537678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.537678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.537678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.537678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.538095] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.538095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.538095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.538375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.538375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.538507] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 already deleted. [ 682.538554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.555483] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.555664] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.555794] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.555965] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.556287] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-a5e99210-c258-4725-b39d-b0f215e50345 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.556457] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.556575] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.556901] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.557119] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e99210-c258-4725-b39d-b0f215e50345',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.795336] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 682.795617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.832975] env[65231]: INFO networking_nsxv3.common.synchronization [req-607a4dd4-e28b-4941-bb4c-5996eb3b1ecb req-bb1b203c-8cea-41fc-b497-33722a381b67 tempest-ServerDiagnosticsTest-531588960 tempest-ServerDiagnosticsTest-531588960-project-member] Enqueued Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 682.833595] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c with Priority: HIGHEST for action security_group_members [ 682.834862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bcea4e4-2c8c-4878-89e4-515969ca794c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.834862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.834862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.834862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.834862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.835187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.835187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.835256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.835380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.835491] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bcea4e4-2c8c-4878-89e4-515969ca794c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.060123] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.060366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.060527] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.060802] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.061033] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.061206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port a5e99210-c258-4725-b39d-b0f215e50345 not found, creating... [ 683.061593] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.061758] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.061858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.062184] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.062323] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.062598] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.062742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.062847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.063087] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.063178] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.063309] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: a5e99210-c258-4725-b39d-b0f215e50345 is going to be created. [ 683.087267] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.087472] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.087593] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087873] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.089937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.090242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.235725] env[65231]: INFO networking_nsxv3.common.synchronization [req-365f2c2c-9619-433b-abfa-e5c1007f472c req-7fb3baed-a450-4dba-bb85-36a872d68758 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 683.236744] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 683.236744] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.236744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.236921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.237024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.237164] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.237264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.237326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.237473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.237562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.237722] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.338712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.338995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.339157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.339503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.339653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.339960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.340136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.340229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.340598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.340799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.340946] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c is going to be updated. [ 683.379405] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.379405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.379661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.380179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.380412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.392742] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: IN_PROGRESS for 2s [ 683.715503] env[65231]: INFO networking_nsxv3.common.synchronization [req-6eb49a7e-d6f4-42b0-b1fc-e06c9faaf4d7 req-380492e1-02ed-4ddf-9906-95d40a661582 tempest-AttachInterfacesUnderV243Test-988713626 tempest-AttachInterfacesUnderV243Test-988713626-project-member] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 683.715615] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGHEST for action security_group_members [ 683.716119] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.716445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.716668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.717071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.717435] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.717640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.717777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.718033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.718200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.718377] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.742128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.742128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.742128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.742128] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 683.785805] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.785805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.785805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.785805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.785805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.792711] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [req-d22032ea-b932-4d35-9306-4b17e45662fd req-76b48b70-5a5a-452d-be8c-652169107998 service nova] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [req-d22032ea-b932-4d35-9306-4b17e45662fd req-76b48b70-5a5a-452d-be8c-652169107998 service nova] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [req-d22032ea-b932-4d35-9306-4b17e45662fd req-76b48b70-5a5a-452d-be8c-652169107998 service nova] Enqueued Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 683.801020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 683.801020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.801020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.801020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.802011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.802206] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.805945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.805945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.805945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.806103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.806506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.806506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.806506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.806506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.806649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.806689] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.807668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e99210-c258-4725-b39d-b0f215e50345 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.807668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.807668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.807827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.807858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e99210-c258-4725-b39d-b0f215e50345',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.224549] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.224705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.224777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.225652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.225652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.225652] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.225652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.225652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.225652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.225901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.225901] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be updated. [ 684.257340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.257493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.257561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.257780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.257931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.268074] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: IN_PROGRESS for 2s [ 684.311773] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.312028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.312125] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.313968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5e99210-c258-4725-b39d-b0f215e50345 with status ACTIVE [ 684.313968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.313968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.313968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.313968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.314545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.316604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.316604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.316604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.316604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5e99210-c258-4725-b39d-b0f215e50345 is going to be updated. [ 684.344090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.344200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.344263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.344443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.344586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.344746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.485045] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 684.485210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.485393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.485606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.485797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.485982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.485982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.486138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.486216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.486436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.486436] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.603403] env[65231]: INFO networking_nsxv3.common.synchronization [None req-8bdee4cb-cdca-439c-8108-af140770390a None None] Enqueued Resource ID: a4f9a3e4-3da7-44be-93ce-42cdc240e39a with Priority: HIGHEST for action port [ 684.603757] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f9a3e4-3da7-44be-93ce-42cdc240e39a with Priority: HIGHEST for action port [ 684.606640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4f9a3e4-3da7-44be-93ce-42cdc240e39a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.606640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4f9a3e4-3da7-44be-93ce-42cdc240e39a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.606640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4f9a3e4-3da7-44be-93ce-42cdc240e39a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.606640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4f9a3e4-3da7-44be-93ce-42cdc240e39a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.606640] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f9a3e4-3da7-44be-93ce-42cdc240e39a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.819478] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.993042] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.994297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.994386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.994615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.995386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.995386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.995386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.995386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.995386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.996324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.996324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.996593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.996593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996704] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.110531] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4f9a3e4-3da7-44be-93ce-42cdc240e39a [ 685.110669] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.110828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.110902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.111168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.111265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.111370] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4f9a3e4-3da7-44be-93ce-42cdc240e39a already deleted. [ 685.111442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4f9a3e4-3da7-44be-93ce-42cdc240e39a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.324431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.325942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.325942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.325942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.325942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.325942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be created. [ 685.352203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.352353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.352443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.352624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.352784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.367392] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: UNINITIALIZED for 2s [ 685.402405] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c in Status: SUCCESS [ 685.402591] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bcea4e4-2c8c-4878-89e4-515969ca794c deletion is rescheduled due to dependency. [ 685.402716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bcea4e4-2c8c-4878-89e4-515969ca794c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.499792] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93d71ddd-aafd-4027-b22a-d8863fc345e7: rpc.has_security_group_logging(os_id): False [ 685.519160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.519160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.519265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.519399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.519495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.519707] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.519805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.519867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.520036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.520219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.520445] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.520546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.520593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.520736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.520810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.520990] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.521096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.521155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.521290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.521414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.521465] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 685.604237] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.604440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.604440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.604814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.604814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.620164] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 685.665955] env[65231]: INFO networking_nsxv3.common.synchronization [req-6fbcc04a-10c0-4c04-9dec-61e0a16ce60e req-b5382d5a-837a-43e4-bd31-be0964133ce5 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: d865f070-2e65-4c38-b5b2-6d8ae985edf7 with Priority: HIGHEST for action security_group_rules [ 685.666656] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d865f070-2e65-4c38-b5b2-6d8ae985edf7 with Priority: HIGHEST for action security_group_rules [ 685.667165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d865f070-2e65-4c38-b5b2-6d8ae985edf7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.667339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d865f070-2e65-4c38-b5b2-6d8ae985edf7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.667448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d865f070-2e65-4c38-b5b2-6d8ae985edf7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.667801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d865f070-2e65-4c38-b5b2-6d8ae985edf7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.667931] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d865f070-2e65-4c38-b5b2-6d8ae985edf7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.804415] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 685.804415] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 685.804723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.190151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.190151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.190151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.190151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.190151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.190151] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d865f070-2e65-4c38-b5b2-6d8ae985edf7 already deleted. [ 686.190151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d865f070-2e65-4c38-b5b2-6d8ae985edf7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.264240] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d44ea7d6-3367-40ef-900f-e3bfd4ae160c tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e with Priority: HIGHEST for action security_group_rules [ 686.264240] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e with Priority: HIGHEST for action security_group_rules [ 686.264441] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.264520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.264613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.265768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.265768] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be5ef3b9-912c-470e-9964-f3a723c7ea7e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.278824] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdb04723-8209-4d79-9e38-c5a195883f28 in Status: SUCCESS [ 686.278824] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 deletion is rescheduled due to dependency. [ 686.278824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.351519] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d07b5d26-5daa-43b8-819c-dfc2fc67b116 tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e with Priority: HIGHEST for action security_group_rules [ 686.352910] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e with Priority: HIGHEST for action security_group_rules [ 686.353253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.353366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.789265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.789459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.789459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.789652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.789745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.789849] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e already deleted. [ 686.789887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.790138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.790331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.790382] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be5ef3b9-912c-470e-9964-f3a723c7ea7e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.314968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.315350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.315350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.315513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.315609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.315707] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be5ef3b9-912c-470e-9964-f3a723c7ea7e already deleted. [ 687.315787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be5ef3b9-912c-470e-9964-f3a723c7ea7e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.379252] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 687.380216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.380572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.380770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.381262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.381262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.381262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.381482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.381585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.381661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.381790] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.635948] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 687.636133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.885770] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.885910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.885969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.886715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.886715] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.886715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.886715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.886715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.886953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.886953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.887131] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.887238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.887299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.887437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.887573] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.887664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.887724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.887865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.887942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.888031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.888118] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.390265] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 688.409026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.409174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.409174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.411149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.411149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.411149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.411149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.411713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.414351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.414351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.414351] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be created. [ 688.496042] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.496042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.496042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.496042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.496042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.510634] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 688.852064] env[65231]: INFO networking_nsxv3.common.synchronization [req-c03e535d-25bc-4ff3-9507-4dc94e2347da req-13154f21-a31b-4ae2-9e02-6afb419adcba tempest-VolumesAssistedSnapshotsTest-128861610 tempest-VolumesAssistedSnapshotsTest-128861610-project-member] Enqueued Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 688.853028] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee33745-1169-4666-835e-545451997389 with Priority: HIGHEST for action security_group_members [ 688.853028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cee33745-1169-4666-835e-545451997389 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.853210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.853210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.853694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.853694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.853694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.853857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.853857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.854450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.854450] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cee33745-1169-4666-835e-545451997389',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.195388] env[65231]: INFO networking_nsxv3.common.synchronization [req-99d75815-e660-47e0-89bb-7c5bac72af87 req-9143f3a7-aa97-402e-9a3f-9428036a2fa2 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 689.196818] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 689.196818] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.196818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.196818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.196818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.196818] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2dbb2af-b0c5-439e-9d41-09f35f22c67b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.358393] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.359573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.359660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.359955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.360072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.360306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.360412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.360512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.360755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.360845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.360942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cee33745-1169-4666-835e-545451997389 is going to be updated. [ 689.405577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.405577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.405577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.405577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.405577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.416670] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cee33745-1169-4666-835e-545451997389 in Status: IN_PROGRESS for 2s [ 689.721428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.721645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.721716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.721876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.721981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.722080] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b already deleted. [ 689.722150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.315299] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0c3d2595-d4e7-436e-ae8a-a40c2bc4b46c None None] Enqueued Resource ID: 8475a890-ca92-483c-8db1-2685925baa8c with Priority: HIGHEST for action port [ 690.315848] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8475a890-ca92-483c-8db1-2685925baa8c with Priority: HIGHEST for action port [ 690.316697] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8475a890-ca92-483c-8db1-2685925baa8c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.316843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8475a890-ca92-483c-8db1-2685925baa8c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.317928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8475a890-ca92-483c-8db1-2685925baa8c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.317928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8475a890-ca92-483c-8db1-2685925baa8c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.318668] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8475a890-ca92-483c-8db1-2685925baa8c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.526486] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 690.526769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.530835] env[65231]: INFO networking_nsxv3.common.synchronization [req-4e90a492-928f-424e-a709-7d2de38ff203 req-0f9c9e8f-8b54-4dfb-87d8-3c65e0320b2a tempest-ServerGroupTestJSON-1782751920 tempest-ServerGroupTestJSON-1782751920-project-member] Enqueued Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 690.531380] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 with Priority: HIGHEST for action security_group_members [ 690.531696] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-891aab68-a374-48cb-ac40-546cb8e3fe02 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.531837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.531905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.532431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.532558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.532682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.532732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.532946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.533178] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('891aab68-a374-48cb-ac40-546cb8e3fe02',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.822446] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8475a890-ca92-483c-8db1-2685925baa8c [ 690.822922] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.825107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.825107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.825245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.825338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.825443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8475a890-ca92-483c-8db1-2685925baa8c already deleted. [ 690.825541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8475a890-ca92-483c-8db1-2685925baa8c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.887077] env[65231]: INFO networking_nsxv3.common.synchronization [req-a2720249-9b57-4963-b693-e2902da03976 req-64ee33d8-b486-4de9-9044-2c7de5cca548 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 690.888399] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 690.888699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.888849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.888914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.889172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.889215] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2dbb2af-b0c5-439e-9d41-09f35f22c67b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.036355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.036355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.036355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.036576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.036654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.037426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.037554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.037687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.037869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.037950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.038067] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 is going to be updated. [ 691.068156] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.068299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.068374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.068762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.068762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.077823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: IN_PROGRESS for 2s [ 691.413048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.413048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.413048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.413048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.413048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.413048] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b already deleted. [ 691.413048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.428200] env[65231]: INFO networking_nsxv3.common.synchronization [req-41422129-9f75-43c2-80e0-99e815f7168b req-b5a31caf-cdf0-42d7-a394-0f648107542a tempest-FloatingIPsAssociationTestJSON-1925842782 tempest-FloatingIPsAssociationTestJSON-1925842782-project-member] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 691.428200] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 691.429096] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cee33745-1169-4666-835e-545451997389 in Status: SUCCESS [ 691.429412] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cee33745-1169-4666-835e-545451997389 deletion is rescheduled due to dependency. [ 691.429636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cee33745-1169-4666-835e-545451997389" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.430048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.433394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.433394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.433394] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.896020] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.896020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.896020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.901926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.901926] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.901926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.901926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.901926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.901926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.901926] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.901926] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.901926] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.901926] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.901926] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.901926] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.901926] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.922111] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.922207] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.922418] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.922532] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.922844] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.923011] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.923131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.923449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.923665] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bb6f12-6c68-4324-938e-c2ef3bf41d10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.935060] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.935184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.935259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.935469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.935563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.935780] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.935882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.935960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.936133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.936212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.936295] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 already deleted. [ 691.936377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.426617] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.426769] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.426922] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.427186] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.427331] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.427478] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port e3bb6f12-6c68-4324-938e-c2ef3bf41d10 not found, creating... [ 692.427730] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.427878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.427987] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.428442] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.428442] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.428702] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.428857] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.429023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.429242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.429313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.429454] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: e3bb6f12-6c68-4324-938e-c2ef3bf41d10 is going to be created. [ 692.452573] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.452783] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.452891] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.453173] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.453438] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.453703] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.744017] env[65231]: INFO networking_nsxv3.common.synchronization [None req-84900fab-0c3b-44ea-a115-ab01da91c5fb None None] Enqueued Resource ID: de839550-3d69-4962-a1bf-5428b747c990 with Priority: HIGHEST for action port [ 692.747809] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de839550-3d69-4962-a1bf-5428b747c990 with Priority: HIGHEST for action port [ 692.747976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-de839550-3d69-4962-a1bf-5428b747c990 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.748127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de839550-3d69-4962-a1bf-5428b747c990" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.748417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de839550-3d69-4962-a1bf-5428b747c990" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.748417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de839550-3d69-4962-a1bf-5428b747c990" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.748512] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de839550-3d69-4962-a1bf-5428b747c990',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.089347] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 in Status: SUCCESS [ 693.089658] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 891aab68-a374-48cb-ac40-546cb8e3fe02 deletion is rescheduled due to dependency. [ 693.089658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-891aab68-a374-48cb-ac40-546cb8e3fe02" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.213870] env[65231]: INFO networking_nsxv3.common.synchronization [req-41422129-9f75-43c2-80e0-99e815f7168b req-68fb53bd-1c39-40ab-b665-7a83eede30fe service nova] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_rules [ 693.214124] env[65231]: INFO networking_nsxv3.common.synchronization [req-41422129-9f75-43c2-80e0-99e815f7168b req-68fb53bd-1c39-40ab-b665-7a83eede30fe service nova] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 693.214209] env[65231]: INFO networking_nsxv3.common.synchronization [req-41422129-9f75-43c2-80e0-99e815f7168b req-68fb53bd-1c39-40ab-b665-7a83eede30fe service nova] Enqueued Resource ID: e3bb6f12-6c68-4324-938e-c2ef3bf41d10 with Priority: HIGHEST for action port [ 693.214697] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_rules [ 693.214832] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 693.214927] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bb6f12-6c68-4324-938e-c2ef3bf41d10 with Priority: HIGHEST for action port [ 693.215380] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.215483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.215520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.215765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.215849] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.216946] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.216946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.216946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.218140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.218140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.218140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.218140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.218140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.218140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.218140] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.218624] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.218624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.218795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.218823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.219123] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bb6f12-6c68-4324-938e-c2ef3bf41d10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.253112] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de839550-3d69-4962-a1bf-5428b747c990 [ 693.253112] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.253112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.253112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.253112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.253112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.253112] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de839550-3d69-4962-a1bf-5428b747c990 already deleted. [ 693.253112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de839550-3d69-4962-a1bf-5428b747c990" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.543039] env[65231]: INFO networking_nsxv3.common.synchronization [req-01039533-bc32-4294-8cf6-3fc7f6a02866 req-81ae1892-39a1-4687-89ae-aebd74dcc661 tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 693.543039] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 693.543039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.543039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.543039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.544258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.544814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.544814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.544814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.545232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.546387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.546387] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.721035] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.721739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.723444] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.725025] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3bb6f12-6c68-4324-938e-c2ef3bf41d10 with status ACTIVE [ 693.725025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.725025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.725025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.725025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.725025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.725296] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.725296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.725376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.725503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.725572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.725764] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.725854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.729373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.729373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.729373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.729373] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3bb6f12-6c68-4324-938e-c2ef3bf41d10 is going to be updated. [ 693.757367] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.757498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.757563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.758611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.758926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.759138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3bb6f12-6c68-4324-938e-c2ef3bf41d10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.048913] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.232968] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.281984] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c4c25898-71ad-4e5e-9094-d0bb6ee2fd40 None None] Enqueued Resource ID: 6eb5c3b8-15b3-443f-a48b-9a205d622d40 with Priority: HIGHEST for action port [ 694.282811] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb5c3b8-15b3-443f-a48b-9a205d622d40 with Priority: HIGHEST for action port [ 694.283031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb5c3b8-15b3-443f-a48b-9a205d622d40 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.283591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb5c3b8-15b3-443f-a48b-9a205d622d40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.283591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb5c3b8-15b3-443f-a48b-9a205d622d40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.283591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb5c3b8-15b3-443f-a48b-9a205d622d40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.283591] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb5c3b8-15b3-443f-a48b-9a205d622d40',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.290122] env[65231]: INFO networking_nsxv3.common.synchronization [req-400814f5-b6cc-4aea-aeeb-7b7936549b1c req-d6d8bcd3-a2b9-4262-b896-0afdc77c30fd tempest-ServerMetadataNegativeTestJSON-2004572260 tempest-ServerMetadataNegativeTestJSON-2004572260-project-member] Enqueued Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 694.290529] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 694.291463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.291636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.291747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.292035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.292203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.292306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.292369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.292692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.292692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292692] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.552625] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.715191] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.715191] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-190" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.715318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-190" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.716044] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-190" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.716044] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.716044] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.716350] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.716436] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.716615] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.716821] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.716928] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.717050] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.717152] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.717452] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.717452] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.717452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.724596] env[65231]: INFO networking_nsxv3.common.synchronization [req-4d34bfc9-2d7f-46d0-b5b4-17033a4f7814 req-31e14cb8-40ab-47a8-8233-dc45878c5e6c tempest-ServersTestBootFromVolume-887912843 tempest-ServersTestBootFromVolume-887912843-project-member] Enqueued Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 694.724904] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78acfd0-0636-44da-8f92-638d0b04c956 with Priority: HIGHEST for action security_group_members [ 694.725211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e78acfd0-0636-44da-8f92-638d0b04c956 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.725318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.725388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.725572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.725726] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.725876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.725950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.726118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.726218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.726300] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e78acfd0-0636-44da-8f92-638d0b04c956',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.733549] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.733713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.733796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.733996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.734103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.734200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be created. [ 694.756619] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.756792] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.756923] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.757111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-190" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.758037] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.758037] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.758037] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.758320] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.758320] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9eb59f-9b65-48de-84b0-05f8bcb2988b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.766541] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.777082] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: UNINITIALIZED for 2s [ 694.787254] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eb5c3b8-15b3-443f-a48b-9a205d622d40 [ 694.787254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.787254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.787254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.787254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.787254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.787254] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eb5c3b8-15b3-443f-a48b-9a205d622d40 already deleted. [ 694.787254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb5c3b8-15b3-443f-a48b-9a205d622d40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796949] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 already deleted. [ 694.796949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.056173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.056349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.056435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.056921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.056921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.056921] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 695.092128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.092260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.092297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.092511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.092654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104074] env[65231]: INFO networking_nsxv3.common.synchronization [req-2f6d3ff6-589e-49ab-956b-6beccde4ddfd req-57808663-69a0-4729-a36d-0de3783ea20d tempest-ListServersNegativeTestJSON-1349107749 tempest-ListServersNegativeTestJSON-1349107749-project-member] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 695.105843] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 695.106412] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGHEST for action security_group_members [ 695.106737] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.106860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.229343] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.229502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.229574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.229796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.229906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.230133] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.230232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.230294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.230459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.230606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.230707] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 is going to be updated. [ 695.259528] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.259528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.259528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.260118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.260118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.261634] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.261815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.261937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.262215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.262355] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.262499] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 2c9eb59f-9b65-48de-84b0-05f8bcb2988b not found, creating... [ 695.262755] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.262982] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.263104] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.263308] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.263435] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.263705] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.263852] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.263959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.264163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.264339] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.264408] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 2c9eb59f-9b65-48de-84b0-05f8bcb2988b is going to be created. [ 695.279612] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: IN_PROGRESS for 2s [ 695.301373] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.301664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.301882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.302331] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.302690] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.303080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.987132] env[65231]: INFO networking_nsxv3.common.synchronization [req-400814f5-b6cc-4aea-aeeb-7b7936549b1c req-4cd98c8f-e5db-4ed3-91a7-8b254843cb1d service nova] Enqueued Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_rules [ 695.987316] env[65231]: INFO networking_nsxv3.common.synchronization [req-400814f5-b6cc-4aea-aeeb-7b7936549b1c req-4cd98c8f-e5db-4ed3-91a7-8b254843cb1d service nova] Enqueued Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 695.987447] env[65231]: INFO networking_nsxv3.common.synchronization [req-400814f5-b6cc-4aea-aeeb-7b7936549b1c req-4cd98c8f-e5db-4ed3-91a7-8b254843cb1d service nova] Enqueued Resource ID: 2c9eb59f-9b65-48de-84b0-05f8bcb2988b with Priority: HIGHEST for action port [ 695.990483] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_rules [ 695.996084] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 695.996084] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c9eb59f-9b65-48de-84b0-05f8bcb2988b with Priority: HIGHEST for action port [ 695.996084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.996084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.996084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.996084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996999] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c9eb59f-9b65-48de-84b0-05f8bcb2988b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.499806] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.500117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.500168] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.501255] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c9eb59f-9b65-48de-84b0-05f8bcb2988b with status ACTIVE [ 696.501255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.501381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.501381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.501594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.501698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.501899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.501990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.502066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.502222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.502299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.502492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.502602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.502663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.503076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.503076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.503076] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c9eb59f-9b65-48de-84b0-05f8bcb2988b is going to be updated. [ 696.534728] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.534728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.534728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.534728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.536216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.536216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c9eb59f-9b65-48de-84b0-05f8bcb2988b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.762385] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c65595cb-f21d-4107-8594-5b71d91bca7c None None] Enqueued Resource ID: c1778446-957d-4f89-bb55-6be309112e9b with Priority: HIGHEST for action port [ 696.762918] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1778446-957d-4f89-bb55-6be309112e9b with Priority: HIGHEST for action port [ 696.766614] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1778446-957d-4f89-bb55-6be309112e9b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.766806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1778446-957d-4f89-bb55-6be309112e9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.766895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1778446-957d-4f89-bb55-6be309112e9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.767188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1778446-957d-4f89-bb55-6be309112e9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.767275] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1778446-957d-4f89-bb55-6be309112e9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.791522] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 696.791832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.791917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.792243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.792363] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.792450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.792501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.792643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.792721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.792805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.792904] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.007576] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.072957] env[65231]: INFO networking_nsxv3.common.synchronization [req-bd5c4e41-fdfb-4add-b6f1-ec6370bc7b21 req-9944f662-69cc-4b23-8bca-7c404a6567f7 tempest-SecurityGroupRulesTestJSON-1681372084 tempest-SecurityGroupRulesTestJSON-1681372084-project-member] Enqueued Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 697.075009] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b with Priority: HIGHEST for action security_group_rules [ 697.076715] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.076885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.076950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.077177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.077257] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2dbb2af-b0c5-439e-9d41-09f35f22c67b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.119418] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 697.121130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.121130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.121355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.121540] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.121649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.121740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.121984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.121984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.122120] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.269594] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1778446-957d-4f89-bb55-6be309112e9b [ 697.269848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.269989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.270073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.270285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.270383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.271556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1778446-957d-4f89-bb55-6be309112e9b already deleted. [ 697.271556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1778446-957d-4f89-bb55-6be309112e9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.288529] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e78acfd0-0636-44da-8f92-638d0b04c956 in Status: SUCCESS [ 697.288529] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e78acfd0-0636-44da-8f92-638d0b04c956 deletion is rescheduled due to dependency. [ 697.288529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e78acfd0-0636-44da-8f92-638d0b04c956" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.296463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.296633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.296683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.296926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.297124] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.297237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.297298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.297467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.297789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.297789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.297789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.297935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.297935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.298079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.298220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.298309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.298370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.298557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.298649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.298730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.298817] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.511288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.511288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.511288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.511288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.511288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.511288] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 is going to be created. [ 697.539487] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.539872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.539872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.539994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.540170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.550168] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: UNINITIALIZED for 2s [ 697.582903] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ce7388fa-d31d-4f40-9c1f-41a664f540cd None None] Enqueued Resource ID: c5e7d321-5b08-40d9-84ed-9a41352f068c with Priority: HIGHEST for action port [ 697.584359] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e7d321-5b08-40d9-84ed-9a41352f068c with Priority: HIGHEST for action port [ 697.585009] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e7d321-5b08-40d9-84ed-9a41352f068c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.585148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e7d321-5b08-40d9-84ed-9a41352f068c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.585216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e7d321-5b08-40d9-84ed-9a41352f068c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.585473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e7d321-5b08-40d9-84ed-9a41352f068c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.585551] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e7d321-5b08-40d9-84ed-9a41352f068c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.602674] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.602931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.602931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.603144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.604221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.604221] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2dbb2af-b0c5-439e-9d41-09f35f22c67b already deleted. [ 697.604221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2dbb2af-b0c5-439e-9d41-09f35f22c67b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.625213] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.625213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.625213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.625352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.625398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.625633] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.626825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.626825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.626825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.626825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.626825] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be updated. [ 697.660534] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.660688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.660749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.660953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.661109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.675213] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: IN_PROGRESS for 2s [ 697.802821] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8484bf59-35bd-4576-8ebe-fc2e1520b057: rpc.has_security_group_logging(os_id): False [ 697.823992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.824156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.824231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.824443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.824535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.824836] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.824941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.824984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.825145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.825219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.825408] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.825565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.825565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.825684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.825776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.825953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.826060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.826120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.826279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.826355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.826483] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be created. [ 697.875932] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 697.875932] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 697.876869] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 697.877191] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 697.879251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.879251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.879251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.879251] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.880920] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.881067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.881143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.881428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.881428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.881513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.881543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.881936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.881936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.881936] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.900873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.900873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.900873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.900873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.901130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.913212] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 697.930459] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 697.930773] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 697.930970] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_rules [ 697.931140] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 697.931291] env[65231]: INFO networking_nsxv3.common.synchronization [req-5c8d189f-f485-4049-8271-8ea7b1c1c1b8 req-8d2b8c90-4d92-4c92-9b34-8fe6f3c7b681 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 697.932149] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 697.933384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_rules [ 697.933384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 697.933384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 697.933384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 697.933384] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.933384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.933384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.933384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.933384] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.934692] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.935567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.935698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.936568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.938437] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.938437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e99210-c258-4725-b39d-b0f215e50345 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.938437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.938437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.938437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.938437] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e99210-c258-4725-b39d-b0f215e50345',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.939302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.939410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.939939] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.940204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.088072] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5e7d321-5b08-40d9-84ed-9a41352f068c [ 698.088445] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.088607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.088607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.088934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.088934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.089117] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5e7d321-5b08-40d9-84ed-9a41352f068c already deleted. [ 698.089146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e7d321-5b08-40d9-84ed-9a41352f068c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.383228] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.384248] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.441623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.441761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.442060] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.442163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.442309] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5e99210-c258-4725-b39d-b0f215e50345 with status ACTIVE [ 698.442471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.442602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.442682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.443237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.443237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.443237] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.443399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.443399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.444196] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.444196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.444503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5e99210-c258-4725-b39d-b0f215e50345 is going to be updated. [ 698.471021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.471021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.471021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.471021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.471021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.471021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.889901] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.890956] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.092658] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 699.092658] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 699.092658] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 699.093036] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 699.093226] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 699.093286] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 699.093564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.093693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.093744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.093995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.094173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.094271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.094369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.094490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.095022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.095022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.095579] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.095677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.096690] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.096774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.153182] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 699.153452] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 699.153530] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_rules [ 699.153597] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 699.154188] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_rules [ 699.154188] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 699.154188] env[65231]: INFO networking_nsxv3.common.synchronization [req-efd5ba4c-2ffb-445b-b7f7-d4ce0a8d7061 req-dd9f372f-a3fe-40c0-ad7f-467416c72ff5 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 699.154494] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 699.154630] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_rules [ 699.154754] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 699.155655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e99210-c258-4725-b39d-b0f215e50345 with Priority: HIGHEST for action port [ 699.155655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_rules [ 699.155655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 699.155655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 699.155655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.155655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.155655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.156087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.156087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.156087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.156223] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.156977] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.157037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.157227] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e99210-c258-4725-b39d-b0f215e50345 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.158689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.158689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.158689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.158689] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e99210-c258-4725-b39d-b0f215e50345',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.160033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.160033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.160033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.160033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.160033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.160033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.393535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.393688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.393762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.393982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.394746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.394746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 699.396759] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.396939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.397033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.397176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.397814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.397814] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be created. [ 699.431558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.432098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.432216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.432362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.432569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.445906] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.446044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.446118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.446340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.446488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.458094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: UNINITIALIZED for 2s [ 699.459593] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 699.559052] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: SUCCESS [ 699.559302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.559514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.559691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.559880] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.560014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.560074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.560726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.560819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.560915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.561019] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.598659] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.661281] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5e99210-c258-4725-b39d-b0f215e50345 with status ACTIVE [ 699.662032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.662032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.662032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.662032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.662032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.662268] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.662313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.662355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.662503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.662581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.662760] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.662871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.663047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.663098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.663177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.663237] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5e99210-c258-4725-b39d-b0f215e50345 is going to be updated. [ 699.664435] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.664596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.684785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070cab8d-4383-4e42-847f-e29c9f10471f in Status: SUCCESS [ 699.684785] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f deletion is rescheduled due to dependency. [ 699.685043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.689982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.690904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.690904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.690904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.690904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.690904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e99210-c258-4725-b39d-b0f215e50345" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.926858] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 699.927142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.993407] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e0090833-1a52-4a61-98be-aa6539d7116b None None] Enqueued Resource ID: c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4 with Priority: HIGHEST for action port [ 699.994078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4 with Priority: HIGHEST for action port [ 699.994415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.994601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.994731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.995077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.995158] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.064097] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.064097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.064097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.064425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.064495] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.064595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.065389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.065389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.065389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.065389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.065389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.065588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.065588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.065673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.066467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.066467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.066467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.066467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.066467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.066467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.066737] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.103421] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.260782] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe9ec620-b0de-49f2-b1d9-63bc78b302e8 req-2283e4aa-2319-41df-a7a6-eb01b6c18e22 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 700.261330] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 700.261637] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.261770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.261837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.262451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.262629] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.262740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.262804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.262964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.263065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.263163] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.496753] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4 [ 700.496983] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.497155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.497198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.498060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.498060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.498060] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4 already deleted. [ 700.498060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7d42d6e-29de-4ab9-be59-5c1b8f06c8e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.568603] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b152afd-9129-4bd3-b47d-6533ebe5e687: rpc.has_security_group_logging(os_id): False [ 700.594864] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.595058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.595252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.595693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.595849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.596118] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.596211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.596277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.596491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.596530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.596729] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.596906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.596906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.597037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.597115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.597326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.597398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.599030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.599030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.599030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.599030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 is going to be created. [ 700.607082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.608175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.608256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.609079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.609724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.610392] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b is going to be created. [ 700.635150] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.635150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.635150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.635351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.635459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.647083] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: UNINITIALIZED for 2s [ 700.675856] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.675856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.675856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.676189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.676238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.694022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: IN_PROGRESS for 2s [ 700.699018] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.699231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-870" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.699388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-870" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.699719] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-870" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.700026] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.701419] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.701644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.701878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.702043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.702412] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.702530] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.702900] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.703043] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.703198] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.703281] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.703424] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.738205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.738397] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.738538] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.739360] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-870" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.739360] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-7ef1a2e9-25a6-4963-bf86-22616d2871a6 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.739360] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.739566] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.739774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.739934] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef1a2e9-25a6-4963-bf86-22616d2871a6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.766203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.766432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.766542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.767640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.767640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.767640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.767640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.767640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.767640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.767978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.767978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e already deleted. [ 700.767978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.246688] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.246957] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.247144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.247318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.247469] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.247618] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 7ef1a2e9-25a6-4963-bf86-22616d2871a6 not found, creating... [ 701.247872] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.248812] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.248812] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.248812] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.248812] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.248812] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.249182] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.249334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.249470] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 is going to be created. [ 701.272586] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.272853] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.273011] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.273362] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.273636] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.273897] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.470685] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 701.470933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.471140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.471360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.471563] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.471695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.471762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.472009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.472101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.472197] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.473658] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 701.473826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.473967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.474144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.474301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.474403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.474468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.474606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.474686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.474769] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.977254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.978326] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.027412] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe9ec620-b0de-49f2-b1d9-63bc78b302e8 req-c7b366b7-ba00-46d5-afb9-ae972445342e service nova] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 702.027610] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe9ec620-b0de-49f2-b1d9-63bc78b302e8 req-c7b366b7-ba00-46d5-afb9-ae972445342e service nova] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 702.027758] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe9ec620-b0de-49f2-b1d9-63bc78b302e8 req-c7b366b7-ba00-46d5-afb9-ae972445342e service nova] Enqueued Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 702.028665] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 702.029171] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 702.029656] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 702.030945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.031118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.031211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.031900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.032178] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.033275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.033405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.033472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.033717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.034111] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.034111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.034276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.034323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.034410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.034510] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.035472] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef1a2e9-25a6-4963-bf86-22616d2871a6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.035593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.035593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.035722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.035799] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef1a2e9-25a6-4963-bf86-22616d2871a6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.481303] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.482737] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.537878] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.538021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.538270] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.542163] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with status ACTIVE [ 702.542320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.542379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.542413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.542606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.542688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.542856] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.542950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.543019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.543159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.543228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.543397] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.543483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.543540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.543669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.543737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.543815] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 is going to be updated. [ 702.566901] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.567062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.567135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.567337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.567471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.567625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.661784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: UNINITIALIZED for 4s [ 702.706799] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: SUCCESS [ 702.706799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.938979] env[65231]: INFO networking_nsxv3.common.synchronization [req-0a5aab1e-7adb-4e34-8fb7-5e9b44d7aee6 req-30586a3e-dfb8-4001-8533-ab2091bc79ec tempest-ImagesOneServerTestJSON-1481344964 tempest-ImagesOneServerTestJSON-1481344964-project-member] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 702.939477] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 702.939814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.939940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.940038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.941605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.941605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.941761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.941796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.942023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.942128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.942260] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.984695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.984695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.984695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.984960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.984960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.984960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 702.987018] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.987018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.987018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.987018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.987018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.987018] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 703.030326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.030326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.030326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.030326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.030326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.036457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.036667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.036743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.037433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.037433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.040660] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.058248] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 703.059729] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 703.444957] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.445172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.445231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.445430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.445528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.445724] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.445870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.445915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.446045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.446121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.446206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 already deleted. [ 703.446283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.523510] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.523510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-487" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.523510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-487" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.523510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-487" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.523882] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.523882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.523882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.524025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.524160] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.524359] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.524478] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.524607] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.524813] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.524813] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.524884] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.524978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.545142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.545298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.545372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.545575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.545670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.545792] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be created. [ 703.549630] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.549784] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.549944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.550737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-487" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.550737] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-425c0a15-b66b-415f-980c-9f5cabe06a53 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.550737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.550737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.551043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.551175] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('425c0a15-b66b-415f-980c-9f5cabe06a53',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.572508] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.572726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.572726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.572925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.573179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.584833] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: UNINITIALIZED for 2s [ 704.054012] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.054274] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.054399] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.054709] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.054889] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.055102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 425c0a15-b66b-415f-980c-9f5cabe06a53 not found, creating... [ 704.055368] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.055556] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.055694] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.055962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.056148] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.056463] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056627] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.057027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.057179] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.057344] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 425c0a15-b66b-415f-980c-9f5cabe06a53 is going to be created. [ 704.079750] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.079966] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.080017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.080321] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.080557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.080816] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.673714] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: SUCCESS [ 704.673714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.674238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.674238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.674351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.674513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.674588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.674979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.674979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.674979] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.809303] env[65231]: INFO networking_nsxv3.common.synchronization [req-0a5aab1e-7adb-4e34-8fb7-5e9b44d7aee6 req-d4394e3e-c14a-4b59-a343-e0abd8ffcabc service nova] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_rules [ 704.809474] env[65231]: INFO networking_nsxv3.common.synchronization [req-0a5aab1e-7adb-4e34-8fb7-5e9b44d7aee6 req-d4394e3e-c14a-4b59-a343-e0abd8ffcabc service nova] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 704.809600] env[65231]: INFO networking_nsxv3.common.synchronization [req-0a5aab1e-7adb-4e34-8fb7-5e9b44d7aee6 req-d4394e3e-c14a-4b59-a343-e0abd8ffcabc service nova] Enqueued Resource ID: 425c0a15-b66b-415f-980c-9f5cabe06a53 with Priority: HIGHEST for action port [ 704.810142] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_rules [ 704.810277] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 704.810376] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425c0a15-b66b-415f-980c-9f5cabe06a53 with Priority: HIGHEST for action port [ 704.810694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.810791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.810889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.811121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.811208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.812274] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.812393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.812450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.813743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.813743] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.813743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.813743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.813743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.813743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.813743] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.817555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-425c0a15-b66b-415f-980c-9f5cabe06a53 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.818266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.818266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.818266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.818266] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('425c0a15-b66b-415f-980c-9f5cabe06a53',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.931036] env[65231]: INFO networking_nsxv3.common.synchronization [req-cd8827cb-02dc-4618-80c1-554f1e57fe55 req-541d6972-b94e-4046-9828-30165b2c9435 tempest-ServersAdminNegativeTestJSON-1762838769 tempest-ServersAdminNegativeTestJSON-1762838769-project-member] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 704.931036] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 704.931036] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.931036] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.931036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.931036] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.070823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 705.071121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.071904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 705.072085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.072240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.072454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.072647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.072768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.072826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.073199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.073326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.073414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.073516] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.074624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.074794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.075088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.075088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.075231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.075265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.075335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.075411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.075536] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.076458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.076622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.076775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.076882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.076940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.077117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.077191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.077275] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.078574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.078574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.078574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.177639] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.319982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.323513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.323513] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 425c0a15-b66b-415f-980c-9f5cabe06a53 with status ACTIVE [ 705.323513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.323513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.323513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.324191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.324191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.324191] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.324191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.324424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.324424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.324479] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 425c0a15-b66b-415f-980c-9f5cabe06a53 is going to be updated. [ 705.348597] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.348809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.348809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.349028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.351447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.351447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-425c0a15-b66b-415f-980c-9f5cabe06a53" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.433828] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.577566] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.580702] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.584369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.584369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.584369] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.601223] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 705.601223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.601963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.601963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.602058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.602122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.603417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.603417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.603417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603417] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.682502] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.826809] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.936084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.082420] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86b6679c-89d1-48f3-bc4c-125e7f8f71df: rpc.has_security_group_logging(os_id): False [ 706.086487] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.087587] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.103745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.103924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.104586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.104586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.104586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.104773] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.105172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.105172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.105231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.105298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.105441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be created. [ 706.107255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.107384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.107455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.107614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.107800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.107893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.107989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.108246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.108478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.108587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.108798] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.108912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.108992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.109180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.109369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.109519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.110090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.110090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.110090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.110269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.110269] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.177467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.177467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.177467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.177467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.177467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.187795] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.188073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.188158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.188371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.188468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.188603] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b is going to be updated. [ 706.190453] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 706.225174] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.225379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.225466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.225661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.225826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.259419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: IN_PROGRESS for 2s [ 706.329855] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.332167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.332167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.332167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.332167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.332167] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 is going to be created. [ 706.357559] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.357710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.357782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.358013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.358189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.371290] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: UNINITIALIZED for 2s [ 706.442946] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.443142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.443207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.443432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.443532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.443630] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be updated. [ 706.479178] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.479331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.479404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.479634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.479788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 706.589161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.589344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.589384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.589590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.589701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.589820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 706.591138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.591256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.591329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.591491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.591619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.591690] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 706.613582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc2e8f3b-861c-4ff7-a89a-56fa66584a5e: rpc.has_security_group_logging(os_id): False [ 706.624257] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.624449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.624553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.624824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.625029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.634223] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.634379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.634472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.634624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.634789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.637042] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.637252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.637252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.637479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.637765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.637838] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.637938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.638041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.638254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.638373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.638622] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.638753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.638809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.638941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.639026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.639224] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.639312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.639362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.639492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.639659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.639659] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be created. [ 706.641281] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 706.642710] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 706.751050] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.751050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.751050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.751479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.751479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.777007] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 708.141321] env[65231]: INFO networking_nsxv3.common.synchronization [req-68c06c98-f468-4d3f-be4d-f4a3de2cfd49 req-08439a55-c67c-4d7b-b0ad-24f82c733449 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 708.141321] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 708.141716] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.141805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.141839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.143465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.143643] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.143752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.143817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.144465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.144578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.144675] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.213575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 708.213865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.214172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.214460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.214617] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.276017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: SUCCESS [ 708.276322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.276504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.277277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.277277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.277277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.277277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.277483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.277483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.277483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.277592] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.387982] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: SUCCESS [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.387982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.387982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.387982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.439653] env[65231]: INFO networking_nsxv3.common.synchronization [None req-414cfe81-eb6e-4440-a825-745ef2b8424a None None] Enqueued Resource ID: e8d9fb42-0766-4f68-aeb6-928f185b88cc with Priority: HIGHEST for action port [ 708.442465] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8d9fb42-0766-4f68-aeb6-928f185b88cc with Priority: HIGHEST for action port [ 708.443272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8d9fb42-0766-4f68-aeb6-928f185b88cc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.443272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8d9fb42-0766-4f68-aeb6-928f185b88cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.443272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8d9fb42-0766-4f68-aeb6-928f185b88cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.443557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8d9fb42-0766-4f68-aeb6-928f185b88cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.443647] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8d9fb42-0766-4f68-aeb6-928f185b88cc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.506405] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 708.506703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.548597] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.548873] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.549540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.549540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.549761] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.549921] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.550106] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.550343] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.550479] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.550790] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.551177] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.551177] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.551177] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.551319] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.551319] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.552222] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.572938] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.573100] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.573838] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.573838] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.573838] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.573838] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.574131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.574267] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.574394] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.646597] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.646782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.646844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.647024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.647121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.647331] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.647414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.647536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.647629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.647916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.647916] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 already deleted. [ 708.647916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.651104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 708.651291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.651437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.651614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.651775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.651882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.651929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.652108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.652186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.652279] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.653810] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 708.653895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.654355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.654521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.654671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.654775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.654837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.654977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.655066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.655158] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.719288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.719410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.784073] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.794515] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 708.794820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.890931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.891285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.891285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.891751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.891751] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.891751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.891751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.891930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.892009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.892103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.892250] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.892362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.892398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.892535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.892671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.892764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.892821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.892972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.893127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.893127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.895301] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.947470] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8d9fb42-0766-4f68-aeb6-928f185b88cc [ 708.947470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.947470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.947655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.947749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.947913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.948035] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8d9fb42-0766-4f68-aeb6-928f185b88cc already deleted. [ 708.948133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8d9fb42-0766-4f68-aeb6-928f185b88cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.077388] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.077539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.080080] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 not found, creating... [ 709.080080] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.080080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.080080] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.080865] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.080865] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.080865] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.080865] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.080865] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 is going to be created. [ 709.106136] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.106494] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.106636] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.106935] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.107184] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.107415] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.157260] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.159744] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.284582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 048f7577-8ddf-44da-9165-34de6c108c3b: rpc.has_security_group_logging(os_id): False [ 709.317181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.317181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.317181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.318365] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b is going to be created. [ 709.398547] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3: rpc.has_security_group_logging(os_id): False [ 709.450014] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.450206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.450403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.451668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.451781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.453420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.453959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.453959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.453959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.454063] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 is going to be created. [ 709.492657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.492842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.492888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.493171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.493351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.514046] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: IN_PROGRESS for 2s [ 709.550179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.550179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.550179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.550179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.550179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.567089] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: IN_PROGRESS for 2s [ 709.660401] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.661487] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.856198] env[65231]: INFO networking_nsxv3.common.synchronization [req-68c06c98-f468-4d3f-be4d-f4a3de2cfd49 req-fff1f3bb-28af-4eff-9676-b76a1215a239 service nova] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 709.856198] env[65231]: INFO networking_nsxv3.common.synchronization [req-68c06c98-f468-4d3f-be4d-f4a3de2cfd49 req-fff1f3bb-28af-4eff-9676-b76a1215a239 service nova] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 709.856198] env[65231]: INFO networking_nsxv3.common.synchronization [req-68c06c98-f468-4d3f-be4d-f4a3de2cfd49 req-fff1f3bb-28af-4eff-9676-b76a1215a239 service nova] Enqueued Resource ID: b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 with Priority: HIGHEST for action port [ 709.857183] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 709.857832] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 709.858384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 with Priority: HIGHEST for action port [ 709.859110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.859192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.859275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.859618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.859695] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.861161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.861352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.861463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.861753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.861995] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.862174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.862322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.862503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.862648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.862800] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.864048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.864218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.864335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.864574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.864705] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.166071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.166071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.166071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.166659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.166659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.166659] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 710.168189] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.168270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.168337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.168537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.168595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.168682] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 710.200448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.200583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.200779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.200945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.201112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.203418] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.203643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.203718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.203885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.204014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.215123] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 710.215935] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 710.367426] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.368520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.368670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.370140] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 with status ACTIVE [ 710.370837] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.370837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.370837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.370837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.371100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.371100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.371168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.371204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.371345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.371421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.371650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.371767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.371828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.371970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.372057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.372141] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9 is going to be updated. [ 710.396204] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.397072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.397072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.397072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.397281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.397479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b80df51b-e9e1-4bb9-a20e-c3dbf2e6c2e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.685562] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e6a6dae-19ac-428c-9947-e98043b6a97a req-c2881226-2e87-4dc6-9601-de01303aae69 tempest-InstanceActionsV221TestJSON-1884142833 tempest-InstanceActionsV221TestJSON-1884142833-project-member] Enqueued Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 710.686553] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 710.686553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.686553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.686679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.686829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.686976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.687285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.687347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.687507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.687648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.687700] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.870636] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.108055] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.108055] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.108055] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.108781] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.109303] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.109825] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.110119] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.111467] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.111467] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.111467] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.111467] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.111467] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.111859] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.112103] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.112354] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.112661] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.134909] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.135082] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.136723] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.136723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.136723] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-f3ab3853-6a8c-449a-988a-999a116a93dc taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.136723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.136723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.136723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.136723] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ab3853-6a8c-449a-988a-999a116a93dc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.191203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.191951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.191951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.191951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.192067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.192278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.192411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.192506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.192789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.192789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.193116] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 already deleted. [ 711.193116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.373041] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.373227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.373292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.373522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.373612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.373712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be created. [ 711.395742] env[65231]: INFO networking_nsxv3.common.synchronization [None req-dae4e4b2-3cdf-46dc-942e-d53e5af0c956 None None] Enqueued Resource ID: 1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b with Priority: HIGHEST for action port [ 711.396275] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b with Priority: HIGHEST for action port [ 711.396570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.396724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.396799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.397138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.397224] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.402289] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.402419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.402473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.402666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.402846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.416207] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: UNINITIALIZED for 2s [ 711.531639] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: SUCCESS [ 711.531820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.584930] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: SUCCESS [ 711.585163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.642120] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.642120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.642120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.642326] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.642601] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.642601] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port f3ab3853-6a8c-449a-988a-999a116a93dc not found, creating... [ 711.642947] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.643159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.643289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.643772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.643772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.643947] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.644287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.644287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.644485] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.644618] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.644784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: f3ab3853-6a8c-449a-988a-999a116a93dc is going to be created. [ 711.666497] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.667938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.667938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.667938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.667938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.668184] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.900250] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b [ 711.900502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.900655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.900725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.900993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.901202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.901271] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b already deleted. [ 711.901360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dfe8a8c-e616-46ee-a67e-1a3cdb272d2b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.228813] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 712.231596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.231596] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 712.231596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.231596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.231824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232097] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.232382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.232382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.232694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.232733] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.233703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.233968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.233968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.234081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.234153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.234406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.234491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.234619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.234754] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.234853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.234890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.235080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.235256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.235390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.235475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.235660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.235780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.235892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.236116] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.367892] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e6a6dae-19ac-428c-9947-e98043b6a97a req-6bdcb75e-5a82-48ca-8788-e4d31b634019 service nova] Enqueued Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_rules [ 712.368096] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e6a6dae-19ac-428c-9947-e98043b6a97a req-6bdcb75e-5a82-48ca-8788-e4d31b634019 service nova] Enqueued Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 712.368285] env[65231]: INFO networking_nsxv3.common.synchronization [req-7e6a6dae-19ac-428c-9947-e98043b6a97a req-6bdcb75e-5a82-48ca-8788-e4d31b634019 service nova] Enqueued Resource ID: f3ab3853-6a8c-449a-988a-999a116a93dc with Priority: HIGHEST for action port [ 712.368470] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_rules [ 712.368617] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 712.368737] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3853-6a8c-449a-988a-999a116a93dc with Priority: HIGHEST for action port [ 712.369925] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.370161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.370214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.370514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.370678] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.371646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.371826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.371933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.372157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.372356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.372529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.372622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.372809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.372974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.373088] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.373998] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ab3853-6a8c-449a-988a-999a116a93dc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.374172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.374347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.375435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.378795] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ab3853-6a8c-449a-988a-999a116a93dc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.737869] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.740229] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 712.761655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.761771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.761805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.762092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.762179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.762732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.762732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.762732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.762732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.762941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.762969] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.765873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.765873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.765873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.765873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.766112] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.766203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.766312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.766540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.766626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.767416] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 712.838675] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.838824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.838874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.839124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.839272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.853576] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 712.877334] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.878186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.878307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.879154] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3ab3853-6a8c-449a-988a-999a116a93dc with status ACTIVE [ 712.879154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.879154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.879154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.879390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.879504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.879780] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.879893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.879954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.880159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.880243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.880441] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.880535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.880595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.880803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.880878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.880961] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3ab3853-6a8c-449a-988a-999a116a93dc is going to be updated. [ 712.921265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.921492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.921492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.922110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.922110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.922110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ab3853-6a8c-449a-988a-999a116a93dc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.242800] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86b6679c-89d1-48f3-bc4c-125e7f8f71df: rpc.has_security_group_logging(os_id): False [ 713.275915] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.275915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.275915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.276136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.276136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.276297] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.276421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.276489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.276654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.276751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.276873] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 713.368464] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.368728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.368728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.370593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.370814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.384160] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.390522] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 713.433968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.437021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437021] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.890171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.890353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.890415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.890680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.890819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.890889] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 is going to be created. [ 713.926758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.926871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.926871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.927148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.927794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.940175] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: UNINITIALIZED for 2s [ 713.942988] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.445155] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 815e1e30-e3ab-42b0-b86b-fcd2a81435a2: rpc.has_security_group_logging(os_id): False [ 714.470033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470033] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be created. [ 714.546956] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.547097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.547159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.547387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.547619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.559730] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 714.871023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 714.871023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.871023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.871023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.871023] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.372500] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.372664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.372736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.372966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.373183] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.373289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.373356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.373512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.373599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.373679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.373771] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.407146] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 715.407146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.876964] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.876964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.876964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.876964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.877409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.877409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.877409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.877409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.877560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.877560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.877731] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.878257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.878257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.878257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.878257] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.878257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.878257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.878519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.878519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878613] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.952893] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: SUCCESS [ 715.953221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.953397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.953605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.953797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.953914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.953977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.954139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.954220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.954299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.954413] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.380622] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 716.400949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.401169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.401209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.401481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.401523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.401714] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.401813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.401872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.402031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.402109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.402300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.402469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.402469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.402606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.402642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.402824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.402888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.402945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.403117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.403196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.403297] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 716.457520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.457738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.457887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.458136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.458374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.458485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.458564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.458749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.458829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.458919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.459084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.459177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.459324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.459482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.459701] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.459820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.460082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.460082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.460202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.460786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.460786] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.468062] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.468336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.468336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.468482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.468657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.504259] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 716.576194] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 716.576194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.963389] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 958c3ba3-f0b2-4eeb-830e-ed8b206a3477: rpc.has_security_group_logging(os_id): False [ 717.006193] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.006193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.006193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.006502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.006502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.006603] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.006672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.006730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.006907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.006992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.007290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.007350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.007488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.007746] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.007840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.007898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.008053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.008130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.008212] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 is going to be created. [ 717.071747] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.071937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.071999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.072243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.072462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.084411] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: IN_PROGRESS for 2s [ 717.369695] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 717.369822] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 718.520393] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 718.520815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.838960] env[65231]: INFO networking_nsxv3.common.synchronization [req-16b916c8-b60d-4b27-bdd7-e5a6f5221605 req-a3539b2a-6a47-48d3-b0d0-e6ba15d5cf74 tempest-ServerMetadataNegativeTestJSON-2004572260 tempest-ServerMetadataNegativeTestJSON-2004572260-project-member] Enqueued Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 718.839544] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 with Priority: HIGHEST for action security_group_members [ 718.839852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b152afd-9129-4bd3-b47d-6533ebe5e687 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.840033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.840137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.840348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.840504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.840608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.840735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.840884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.840973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.841080] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b152afd-9129-4bd3-b47d-6533ebe5e687',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.100469] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: SUCCESS [ 719.100823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.346026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.346026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.346026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.346026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.346026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.346341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.346341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.346341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.346468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.346541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.346656] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 is going to be updated. [ 719.399177] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.399177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.399338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.399608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.399848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.414934] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: IN_PROGRESS for 2s [ 721.427202] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 in Status: SUCCESS [ 721.427457] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b152afd-9129-4bd3-b47d-6533ebe5e687 deletion is rescheduled due to dependency. [ 721.427495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b152afd-9129-4bd3-b47d-6533ebe5e687" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.216300] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 722.216628] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 722.217014] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 722.217114] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 722.217386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.217507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.217572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.217763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.217913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.218019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.218080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.218226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.218307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.218396] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.219636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.219743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.219877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.220027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.220162] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.220257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.220320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.220460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.220753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.220753] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.268154] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_rules [ 722.268323] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 722.268452] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 722.268573] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 722.268721] env[65231]: INFO networking_nsxv3.common.synchronization [req-92d70148-183f-4924-aad8-d11fea619e65 req-47b64a78-19c6-4c07-9b48-ec4e21a031ef tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 722.269234] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_rules [ 722.269365] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 722.269464] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 722.269566] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 722.269654] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 722.270168] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.270283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.270355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.270589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.270663] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.271499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.271631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.271692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.272899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.272899] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.272899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef1a2e9-25a6-4963-bf86-22616d2871a6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.272899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.272899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.273224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.273224] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef1a2e9-25a6-4963-bf86-22616d2871a6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.273902] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.273984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.274185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.274258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.358107] env[65231]: INFO networking_nsxv3.common.synchronization [req-0cbea66a-4248-4b1f-ae8a-285890694b34 req-b2b1bccb-3543-4e8d-80c5-2427bf3d0f6f tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 722.358107] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 722.358107] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.358107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.358107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.358107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.358733] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.358981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.359143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.359390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.359569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.359746] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.715676] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.716017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.716017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.716324] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.716567] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.716709] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.716910] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.717150] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.717290] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.717497] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.718904] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.718904] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.718904] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.718904] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.718904] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.718904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.723708] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.724197] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.742276] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.742550] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.743387] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.743387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.743387] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-006d04fe-2e4e-4c0b-9537-e9a93c756932 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.743649] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.743649] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.743866] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.743999] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006d04fe-2e4e-4c0b-9537-e9a93c756932',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.775458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.776276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.776276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.776276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.776276] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with status ACTIVE [ 722.776276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.776661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.776661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.776661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.776661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.776934] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.776934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.776934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.777175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.777175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.777369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.777432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.777517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.777606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.777678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.777799] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 is going to be updated. [ 722.802394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.802394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.802561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.802637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.802761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.803635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.863080] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.863222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.863305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.863500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.863593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.863793] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.863893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.863953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.864125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.864200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.864284] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 already deleted. [ 722.864364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.151380] env[65231]: INFO networking_nsxv3.common.synchronization [req-658eed1b-ee2f-4b98-90c8-2bcefb6103ff req-3ff49855-3894-4adf-8a37-c09ee3d8f541 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 723.151437] env[65231]: INFO networking_nsxv3.common.synchronization [req-658eed1b-ee2f-4b98-90c8-2bcefb6103ff req-3ff49855-3894-4adf-8a37-c09ee3d8f541 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 723.151931] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 723.152078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b with Priority: HIGHEST for action security_group_members [ 723.152345] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.152445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.152624] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.152704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.196854] env[65231]: INFO networking_nsxv3.common.synchronization [req-658eed1b-ee2f-4b98-90c8-2bcefb6103ff req-3ff49855-3894-4adf-8a37-c09ee3d8f541 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 723.196999] env[65231]: INFO networking_nsxv3.common.synchronization [req-658eed1b-ee2f-4b98-90c8-2bcefb6103ff req-3ff49855-3894-4adf-8a37-c09ee3d8f541 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 723.197119] env[65231]: INFO networking_nsxv3.common.synchronization [req-658eed1b-ee2f-4b98-90c8-2bcefb6103ff req-3ff49855-3894-4adf-8a37-c09ee3d8f541 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 723.197763] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_rules [ 723.197919] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 723.198104] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with Priority: HIGHEST for action port [ 723.198461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.198918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.198918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.199014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.199184] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef1a2e9-25a6-4963-bf86-22616d2871a6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.199298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.199408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.199623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.199706] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef1a2e9-25a6-4963-bf86-22616d2871a6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.225153] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.226056] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.248219] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.248438] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.248553] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.249111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.249111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.249654] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 006d04fe-2e4e-4c0b-9537-e9a93c756932 not found, creating... [ 723.249936] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.250116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.250227] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.250451] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.250592] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.251028] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.251161] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.251278] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.251480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.251755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.251755] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 006d04fe-2e4e-4c0b-9537-e9a93c756932 is going to be created. [ 723.272942] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.273292] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.273414] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.273681] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.273906] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.274215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.702162] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef1a2e9-25a6-4963-bf86-22616d2871a6 with status ACTIVE [ 723.702448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.702634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.702778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.703148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.703148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.703343] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.703488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.703488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.703680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.703755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.703933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.704061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.704169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.704260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.704335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.704419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef1a2e9-25a6-4963-bf86-22616d2871a6 is going to be updated. [ 723.728633] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.728963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.729413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.729413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.729413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.729592] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b is going to be created. [ 723.732585] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.732801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.733435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.733435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.733435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.733614] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 723.743587] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.743910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.744029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.744408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.744834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.744932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef1a2e9-25a6-4963-bf86-22616d2871a6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.780973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.781158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.781234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.781449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.781610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.795377] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.795894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.795894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.796051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.796220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.799430] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b in Status: UNINITIALIZED for 2s [ 723.809034] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 724.025195] env[65231]: INFO networking_nsxv3.common.synchronization [req-0cbea66a-4248-4b1f-ae8a-285890694b34 req-3be7617e-8474-405b-a77d-b847cfd9977b service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 724.025195] env[65231]: INFO networking_nsxv3.common.synchronization [req-0cbea66a-4248-4b1f-ae8a-285890694b34 req-3be7617e-8474-405b-a77d-b847cfd9977b service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 724.025195] env[65231]: INFO networking_nsxv3.common.synchronization [req-0cbea66a-4248-4b1f-ae8a-285890694b34 req-3be7617e-8474-405b-a77d-b847cfd9977b service nova] Enqueued Resource ID: 006d04fe-2e4e-4c0b-9537-e9a93c756932 with Priority: HIGHEST for action port [ 724.025195] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 724.025777] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 724.026111] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006d04fe-2e4e-4c0b-9537-e9a93c756932 with Priority: HIGHEST for action port [ 724.026577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.026956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.027179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.027542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.027773] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.029146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.029312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.029462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.029805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.030034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.030245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.030419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.030761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.030905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.031116] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.032776] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-006d04fe-2e4e-4c0b-9537-e9a93c756932 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.032992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.033204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.033485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.033683] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006d04fe-2e4e-4c0b-9537-e9a93c756932',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.535359] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.536612] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.536685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.536996] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 006d04fe-2e4e-4c0b-9537-e9a93c756932 with status ACTIVE [ 724.537172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.537277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.537343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.537551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.537644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.537807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.537904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.537962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.538155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.538206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.538488] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.538488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.538488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.538640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.538715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.538789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 006d04fe-2e4e-4c0b-9537-e9a93c756932 is going to be updated. [ 724.577428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.577683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.577683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.577806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.577971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.578142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-006d04fe-2e4e-4c0b-9537-e9a93c756932" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.038208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.086717] env[65231]: INFO networking_nsxv3.common.synchronization [req-fccdc1ce-77e8-4ce0-80f2-436a88233c88 req-4233e939-c763-4ff2-8d34-fca462d93ffa tempest-FloatingIPsAssociationNegativeTestJSON-1419473329 tempest-FloatingIPsAssociationNegativeTestJSON-1419473329-project-member] Enqueued Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 725.087266] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 725.087567] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.087715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.087777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.089136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.089396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.089517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.089599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.089758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.089819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.089904] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.469535] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.469834] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-320" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.470019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-320" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.470402] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-320" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.470635] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.470847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.471014] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.471283] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.471492] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.471688] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.471831] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.472294] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.472294] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.472294] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.472294] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.472440] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.494715] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.494988] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.495188] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.495426] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-320" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.495925] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-bbe6b50c-acbf-4752-932c-c385264d3556 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.496112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.496579] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.496579] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.496853] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbe6b50c-acbf-4752-932c-c385264d3556',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.542321] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.542518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.542596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.542824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.542925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.543101] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be created. [ 725.573724] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.573891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.573962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.574332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.574523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.584881] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: UNINITIALIZED for 2s [ 725.593532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.593687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.593863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.594104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.594204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.594404] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.594506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.594569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.594722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.595713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.595713] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 already deleted. [ 725.595713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.765396] env[65231]: INFO networking_nsxv3.common.synchronization [req-52359e3b-c2d9-4a44-af8d-8625d6ca9b75 req-246a5dc0-7b82-415a-a45a-e57f399b7ce4 tempest-InstanceActionsV221TestJSON-1884142833 tempest-InstanceActionsV221TestJSON-1884142833-project-member] Enqueued Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 725.765957] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGHEST for action security_group_members [ 725.766277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.766403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.766467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.767483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.767483] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.767483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.767483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.767483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.767483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.767483] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.811387] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b in Status: SUCCESS [ 725.811387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.811387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.811778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.811886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.811974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.812169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.812254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.812316] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.821132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 725.821414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.821511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.821711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.821909] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.822030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.822099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.822261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.822340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.822435] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.001695] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.001868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.001990] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.002277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.002424] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.002573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port bbe6b50c-acbf-4752-932c-c385264d3556 not found, creating... [ 726.002829] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.002978] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.003178] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.003403] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.003521] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.003800] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.003948] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.004101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.004307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.004432] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.004567] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: bbe6b50c-acbf-4752-932c-c385264d3556 is going to be created. [ 726.027062] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.027332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.027415] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.027675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.027899] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.028131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.269123] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.269420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.269420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.270038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.270038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.270038] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.270038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.270038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.270310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.270388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.271397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 is going to be updated. [ 726.299138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.299290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.299363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.299578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.300591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.310569] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: IN_PROGRESS for 2s [ 726.314498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.314648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.314703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.314919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.315042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.315236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.315345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.315398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.315556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.315636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.315709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b is going to be deleted. [ 726.327218] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.393424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.393424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.393424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.393424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.393778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.393778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.393889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.394067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.394244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.394345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.394406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.394547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.394647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.394712] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.717440] env[65231]: INFO networking_nsxv3.common.synchronization [req-fccdc1ce-77e8-4ce0-80f2-436a88233c88 req-16f81496-44cf-4a45-bcfd-b6cc754d95e7 service nova] Enqueued Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_rules [ 726.717606] env[65231]: INFO networking_nsxv3.common.synchronization [req-fccdc1ce-77e8-4ce0-80f2-436a88233c88 req-16f81496-44cf-4a45-bcfd-b6cc754d95e7 service nova] Enqueued Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 726.717734] env[65231]: INFO networking_nsxv3.common.synchronization [req-fccdc1ce-77e8-4ce0-80f2-436a88233c88 req-16f81496-44cf-4a45-bcfd-b6cc754d95e7 service nova] Enqueued Resource ID: bbe6b50c-acbf-4752-932c-c385264d3556 with Priority: HIGHEST for action port [ 726.718304] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_rules [ 726.718448] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 726.718544] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe6b50c-acbf-4752-932c-c385264d3556 with Priority: HIGHEST for action port [ 726.718855] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.718961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.719387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.719878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.720367] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.721519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.721780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.721888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.723088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.723088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.723088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.723088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.723088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.723088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.723088] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.724201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbe6b50c-acbf-4752-932c-c385264d3556 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.725945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.725945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.725945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.725945] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbe6b50c-acbf-4752-932c-c385264d3556',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.831021] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.896862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.897087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.897182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.897700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.898058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.898306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.898397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.898497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.898712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.898795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.898880] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b already deleted. [ 726.898957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.899109] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.900048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.900219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.900477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.900539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.901121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.901260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.901570] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.223180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.223180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.228206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbe6b50c-acbf-4752-932c-c385264d3556 with status ACTIVE [ 727.228444] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.231124] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.231124] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.231124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.231124] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbe6b50c-acbf-4752-932c-c385264d3556 is going to be updated. [ 727.232836] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.257574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.258312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.259238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.259238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.259238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.259238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbe6b50c-acbf-4752-932c-c385264d3556" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.335456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.335456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.335456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.335456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.335456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.335456] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 727.385025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.385167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.385205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.385430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.385572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.397968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 727.405045] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67fac9a1-e911-4d95-92f3-ed7fa1b89d9b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.405921] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.406067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.406134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.406339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.406709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.406709] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.406709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.406846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.406905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.406978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.407070] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b already deleted. [ 727.407145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.596663] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.596663] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.596663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.597498] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.705546] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-fb95e5e1-e75b-40ed-9adb-24b71269b19b tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 727.706479] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 727.707484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.707484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.707484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.707484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.708898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.708898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.708898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.708898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.708898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.708898] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.735345] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.909459] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b: rpc.has_security_group_logging(os_id): False [ 727.929781] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.929781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.929781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.929996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.929996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.931173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.931173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.931173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.931173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.931173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.931173] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b is going to be created. [ 727.955070] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b], does not exist path=[/infra/domains/default/groups/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b]."\n}' [ 727.955070] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b [ 727.955070] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 727.995357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.995576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.995663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.995882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.997861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.998187] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.998317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.998366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.998548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.998622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.998845] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.998936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.998999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.999160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.999233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.999331] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67fac9a1-e911-4d95-92f3-ed7fa1b89d9b is going to be created. [ 728.019036] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b], does not exist path=[/infra/domains/default/groups/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b [ 728.019036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67fac9a1-e911-4d95-92f3-ed7fa1b89d9b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.019036] env[65231]: Traceback (most recent call last): [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 728.019036] env[65231]: return func(*args, **kwargs) [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 728.019036] env[65231]: res.raise_for_status() [ 728.019036] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 728.019036] env[65231]: raise HTTPError(http_error_msg, response=self) [ 728.019036] env[65231]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b [ 728.019036] env[65231]: During handling of the above exception, another exception occurred: [ 728.019036] env[65231]: Traceback (most recent call last): [ 728.019036] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 728.019036] env[65231]: listener.cb(fileno) [ 728.019036] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 728.019036] env[65231]: result = function(*args, **kwargs) [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 728.019036] env[65231]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 728.019036] env[65231]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 728.019036] env[65231]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 728.019036] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 728.019036] env[65231]: res.raise_for_status() [ 728.019036] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 728.019036] env[65231]: raise HTTPError(http_error_msg, response=self) [ 728.019036] env[65231]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67fac9a1-e911-4d95-92f3-ed7fa1b89d9b [ 728.019036] env[65231]: Removing descriptor: 5 [ 728.100006] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.140758] env[65231]: INFO networking_nsxv3.common.synchronization [req-50bb5790-7202-4916-8991-15756bfc9dc2 req-9e2ea6f4-0918-4b3d-9e0a-63242851cd36 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 728.141129] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 728.141447] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.141585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.141666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.141946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.142143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.142275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.142337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.142493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.142641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.142695] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.212018] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.212201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.212311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.212442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.212535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.212789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.212892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.212950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.214262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.214369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.214452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd already deleted. [ 728.214527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.238121] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.238265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.238356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.238758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.238859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.238965] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 is going to be created. [ 728.262678] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.262794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.262794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.263098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.263289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.274088] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: UNINITIALIZED for 2s [ 728.321380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 in Status: SUCCESS [ 728.321563] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 deletion is rescheduled due to dependency. [ 728.321680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.345172] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.345540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.345540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.345763] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.346037] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.346195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.346294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.346510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.346648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.346847] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.346952] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.347067] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.347169] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.347271] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.347371] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.347497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.367193] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.367427] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.367596] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.367820] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.368226] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-05c44b86-96ea-489e-8593-650c1f3f2fda taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.368444] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.368608] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.368991] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.369168] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c44b86-96ea-489e-8593-650c1f3f2fda',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.602338] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 728.622595] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.622837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.622941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.623140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.623259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.623564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.623694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.623769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.623959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.624066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.624187] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be created. [ 728.645225] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.645493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.645493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.645690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.645778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.645973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.646082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.646144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.646291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.646366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.646925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 already deleted. [ 728.646925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.693852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.694046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.694146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.694351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.694562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.719499] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 728.875461] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.875461] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 05c44b86-96ea-489e-8593-650c1f3f2fda not found, creating... [ 728.875461] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.875461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.876116] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.876116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.876116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.876116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.876304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.877228] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 05c44b86-96ea-489e-8593-650c1f3f2fda is going to be created. [ 728.896940] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.897242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.897374] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.897669] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.897953] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.898304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.417826] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 729.417826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.418305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.418390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.418702] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.418893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.418998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.419383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.419669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.419776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.419974] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.421123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.421342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.421570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.421799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.421964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.422210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.422395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.422594] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.628828] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-ab6480b5-11b3-4a56-9149-88d39ab07ff6 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 729.628828] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-ab6480b5-11b3-4a56-9149-88d39ab07ff6 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 729.628828] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-ab6480b5-11b3-4a56-9149-88d39ab07ff6 service nova] Enqueued Resource ID: 05c44b86-96ea-489e-8593-650c1f3f2fda with Priority: HIGHEST for action port [ 729.628828] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 729.628995] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 729.629064] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c44b86-96ea-489e-8593-650c1f3f2fda with Priority: HIGHEST for action port [ 729.630039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.630039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.630039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.630386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.630465] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.632745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.632745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.632745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.632745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.632745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.632745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.632745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.634101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.634101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.634101] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.634101] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-05c44b86-96ea-489e-8593-650c1f3f2fda taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.634101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.634570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.634570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.634664] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c44b86-96ea-489e-8593-650c1f3f2fda',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.664382] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.664515] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.664623] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.664878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.665132] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.665284] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.665401] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.665594] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.665732] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.665925] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.666056] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.666149] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.666249] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.666350] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.666448] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.666570] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.692341] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.692533] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.692667] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.692868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.693264] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-9b301f7e-2c11-4143-9d29-505a5399c426 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.693463] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.693587] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.694055] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.694218] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b301f7e-2c11-4143-9d29-505a5399c426',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.924470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.924645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.924825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.136784] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.137866] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.137980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.140217] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05c44b86-96ea-489e-8593-650c1f3f2fda with status ACTIVE [ 730.140404] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.140501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.140501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.140756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.141147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.141288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.141439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.141517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.141992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.142118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.142326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.142426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.142486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.143238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.143238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.143238] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05c44b86-96ea-489e-8593-650c1f3f2fda is going to be updated. [ 730.169437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.169589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.169694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.169905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.170066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.170231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05c44b86-96ea-489e-8593-650c1f3f2fda" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.200506] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.200743] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.200915] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.201264] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.201429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.201578] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 9b301f7e-2c11-4143-9d29-505a5399c426 not found, creating... [ 730.201906] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.202111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.202227] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.202446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.202648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.202971] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.203806] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.203970] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.204206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.204358] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.204522] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 9b301f7e-2c11-4143-9d29-505a5399c426 is going to be created. [ 730.228377] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.228614] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.228700] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.228954] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.229198] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.229422] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.287147] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: SUCCESS [ 730.287445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.287667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.287962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.288215] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.288337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.288412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.288571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.288653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.288739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.288831] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.427298] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.639828] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.689516] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-4229b70c-9080-49f6-99a5-752c9b2e69c2 tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 730.690130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 730.690539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.690675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.734542] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 730.735249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.792032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.792032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.792032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.792447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.792447] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.792447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.792447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.792561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.792619] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.792870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.792870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.792964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.792964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.793052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.793163] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.929255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.929438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.929585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.929676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.929768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.929868] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 730.932796] env[65231]: INFO networking_nsxv3.common.synchronization [req-50bb5790-7202-4916-8991-15756bfc9dc2 req-d37be25f-3ae4-4179-85c0-2fdf0143e03a service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 730.933219] env[65231]: INFO networking_nsxv3.common.synchronization [req-50bb5790-7202-4916-8991-15756bfc9dc2 req-d37be25f-3ae4-4179-85c0-2fdf0143e03a service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 730.933414] env[65231]: INFO networking_nsxv3.common.synchronization [req-50bb5790-7202-4916-8991-15756bfc9dc2 req-d37be25f-3ae4-4179-85c0-2fdf0143e03a service nova] Enqueued Resource ID: 9b301f7e-2c11-4143-9d29-505a5399c426 with Priority: HIGHEST for action port [ 730.934500] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 730.934635] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 730.934974] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b301f7e-2c11-4143-9d29-505a5399c426 with Priority: HIGHEST for action port [ 730.935270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.935385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.935451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.935689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.935773] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.937559] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.938077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.938146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.938197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.938246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.938400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.938476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.938566] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.939469] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b301f7e-2c11-4143-9d29-505a5399c426 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.939576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.939720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.941147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.941147] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b301f7e-2c11-4143-9d29-505a5399c426',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.965027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.965027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.965027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.965027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.965027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.977682] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 731.142887] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.143102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.143102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.144009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.144009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.144009] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be created. [ 731.169499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.169668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.169712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.169963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.170189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.181380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: UNINITIALIZED for 2s [ 731.295401] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4627e60c-b048-4d11-9490-0fc87e114ba8: rpc.has_security_group_logging(os_id): False [ 731.303462] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.303647] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.303764] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.304036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.304358] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.304513] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.304623] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.304834] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.305083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.305351] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.305466] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.305571] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.305673] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.305874] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.305986] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.306126] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.316514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.316683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.316725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.316927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.317041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.317247] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.317346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.317405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.317554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.317629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.317801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.317883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.317935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.318108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.318184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.318367] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.318456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.318514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.318647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.318720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.318840] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 is going to be created. [ 731.327152] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.327273] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.327420] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.327587] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.327882] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-4b5ef247-162a-4d92-bf57-cad5b0274685 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.328067] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.328183] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.328711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.328822] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5ef247-162a-4d92-bf57-cad5b0274685',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.386725] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.386725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.386915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.386986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.387319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.400323] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: IN_PROGRESS for 2s [ 731.442846] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.444138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.444256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.445866] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b301f7e-2c11-4143-9d29-505a5399c426 with status ACTIVE [ 731.446051] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.446349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.446508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.446561] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.446851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.447048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.447203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.447256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.447316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.447440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.447514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.447590] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b301f7e-2c11-4143-9d29-505a5399c426 is going to be updated. [ 731.484203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.484416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.484514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.484772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.484950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.485185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b301f7e-2c11-4143-9d29-505a5399c426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.832151] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.832405] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.832526] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.832833] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.833040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.833202] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 4b5ef247-162a-4d92-bf57-cad5b0274685 not found, creating... [ 731.833539] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.833756] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.833810] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.834036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.834178] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.834460] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.834610] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.834720] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.835013] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.835220] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.835432] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 4b5ef247-162a-4d92-bf57-cad5b0274685 is going to be created. [ 731.861623] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.861895] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.861977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.862298] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.862538] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.862759] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.945905] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.449056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.449315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.449355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.449564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.449687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.449827] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 732.475869] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.475869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.475869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.475869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.475869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.490872] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: UNINITIALIZED for 2s [ 732.574813] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-9130a4c9-5414-46fe-b623-d5d47db31a30 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 732.574993] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-9130a4c9-5414-46fe-b623-d5d47db31a30 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 732.575150] env[65231]: INFO networking_nsxv3.common.synchronization [req-9932897d-0e0f-4b4f-a99d-45c348d55b87 req-9130a4c9-5414-46fe-b623-d5d47db31a30 service nova] Enqueued Resource ID: 4b5ef247-162a-4d92-bf57-cad5b0274685 with Priority: HIGHEST for action port [ 732.575390] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 732.575513] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 732.575605] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b5ef247-162a-4d92-bf57-cad5b0274685 with Priority: HIGHEST for action port [ 732.576187] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.576293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.576487] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.576569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.576750] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b5ef247-162a-4d92-bf57-cad5b0274685 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.576850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.576913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.577128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.577203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5ef247-162a-4d92-bf57-cad5b0274685',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.989924] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 732.990121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.990291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.990515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.990700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.990849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.990967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.991072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.991157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.991257] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.079649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b5ef247-162a-4d92-bf57-cad5b0274685 with status ACTIVE [ 733.079889] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.080037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.080108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.080332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.080427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.083670] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.083670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.083670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.083850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.083850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.084030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.084116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.084177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.084319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.084391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.084473] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b5ef247-162a-4d92-bf57-cad5b0274685 is going to be updated. [ 733.105178] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.105393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.105393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.105587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.105721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.105883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b5ef247-162a-4d92-bf57-cad5b0274685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.129595] env[65231]: INFO networking_nsxv3.common.synchronization [req-49b2317f-d091-45c5-b0e9-769907ae173a req-06be5830-ea60-45d8-8ebc-984c0ec20f80 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 733.130157] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 733.130458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.130582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.130642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.130853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.135021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.135021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.135021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.135021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.135021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.135021] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.194862] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.194862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.194862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.194862] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.195963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.196202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.196377] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.196485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.196550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.197408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.197652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.197788] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.422925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: SUCCESS [ 733.423249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.494327] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.602980] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.603211] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.603361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.603573] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.603830] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.603984] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.604105] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.604324] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.604462] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.604660] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.604766] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.605068] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.605068] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.605177] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.605211] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.605386] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.627371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.627577] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.627629] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.627795] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.628170] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3c25b853-e28a-473a-bf72-4afa74d9878c taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.628344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.628457] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.628943] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.629095] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c25b853-e28a-473a-bf72-4afa74d9878c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.636246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.636610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.636610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.636754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.661429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.661999] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.662158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.662212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.662464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.662557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.662643] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 733.694019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.694359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.694442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.694671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.694736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.699396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.699525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.699699] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.703856] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 733.996938] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.131293] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.131977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.132117] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.132388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.132534] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.132689] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3c25b853-e28a-473a-bf72-4afa74d9878c not found, creating... [ 734.132975] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.133154] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.133274] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.133483] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.133612] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.133895] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.134119] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.134229] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.134413] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.134560] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.134693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3c25b853-e28a-473a-bf72-4afa74d9878c is going to be created. [ 734.155842] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.156057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.156207] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.156451] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.156681] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.157174] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.201826] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.500907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.501321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.501321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.501444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.501512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.501983] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 734.504843] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 734.505069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.505382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.505532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.505767] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.505863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.505863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.508023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.508023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.508023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.508023] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.542147] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.542418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.542557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.542863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.543133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.559354] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 734.704132] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.704596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.707868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.707868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.707868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.707868] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 734.758537] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.758704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.759095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.759095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.759231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.770093] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 734.871237] env[65231]: INFO networking_nsxv3.common.synchronization [req-49b2317f-d091-45c5-b0e9-769907ae173a req-820ef87f-c86a-46bb-91a7-5fb0bce7c623 service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 734.871404] env[65231]: INFO networking_nsxv3.common.synchronization [req-49b2317f-d091-45c5-b0e9-769907ae173a req-820ef87f-c86a-46bb-91a7-5fb0bce7c623 service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 734.871531] env[65231]: INFO networking_nsxv3.common.synchronization [req-49b2317f-d091-45c5-b0e9-769907ae173a req-820ef87f-c86a-46bb-91a7-5fb0bce7c623 service nova] Enqueued Resource ID: 3c25b853-e28a-473a-bf72-4afa74d9878c with Priority: HIGHEST for action port [ 734.872078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 734.872357] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 734.872357] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c25b853-e28a-473a-bf72-4afa74d9878c with Priority: HIGHEST for action port [ 734.872708] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.872708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.872939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.872939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.873138] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.873812] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.873909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874109] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c25b853-e28a-473a-bf72-4afa74d9878c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.874206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.874266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.874422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.874492] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c25b853-e28a-473a-bf72-4afa74d9878c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.010236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.010637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.010637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.010776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.011641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.011807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.012037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.012551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.012551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.012551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.012658] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.013583] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.013583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.014047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.014047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.014047] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.376636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.376636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.376636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c25b853-e28a-473a-bf72-4afa74d9878c with status ACTIVE [ 735.376960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.376960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.376960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.377157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.377189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.377395] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.377554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.377645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.377811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.377968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.378162] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.378262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.378262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.378384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.378475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.378538] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c25b853-e28a-473a-bf72-4afa74d9878c is going to be updated. [ 735.400434] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.400746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.400746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.400906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.401067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.401187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c25b853-e28a-473a-bf72-4afa74d9878c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.517148] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f698486-5433-4f5d-838f-8989284e2ed7: rpc.has_security_group_logging(os_id): False [ 735.554034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.554034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.554034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.554034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.555082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.555248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.555353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.555656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.555874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.556025] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 735.639456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.639629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.639671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.643350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.644154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.659759] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 735.726990] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 735.727270] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 735.727418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.727603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.727831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.728034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.728161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.728252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.728387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.728474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.728646] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.231102] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.569437] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 736.569789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.569789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.569947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570147] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.570264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.570323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.570479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.570561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.570674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.570888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.570968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.571017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571325] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.571423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.571472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571855] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.735478] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.780618] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 736.781097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.781378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.781693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.781995] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.782230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.782344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.782568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.782723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.782880] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.075831] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc2e8f3b-861c-4ff7-a89a-56fa66584a5e: rpc.has_security_group_logging(os_id): False [ 737.094344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.097276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.097276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.097276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.116667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.116667] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.116667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.116667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.116667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.116667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.116667] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.117046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.117046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.117046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.117138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.117336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.117428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.117487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.117629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.117702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.117783] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 737.190477] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.190671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.190712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.190928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.191106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.206282] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 737.237668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.237827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.237896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.238239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.238386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.238582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 737.285874] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.289220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.290196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.290196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.290196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.290196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.303913] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 737.665215] env[65231]: INFO networking_nsxv3.common.synchronization [req-833e646e-d651-477e-a9dc-fbc7d2fe2f50 req-8aa7a821-13be-43fd-a210-1f5b92d0d95f tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 737.665990] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 737.666699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.667466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.668443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.668542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.668775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.668909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.668967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.669175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.669260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.669361] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.677992] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 737.678247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.789114] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.125471] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.125708] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.125856] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.126540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.127092] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.127221] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.127274] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.127583] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.127822] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.128197] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.128307] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.128938] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.128938] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.128938] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.128938] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.129237] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.152636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.153032] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.153400] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.153708] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.154162] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-2fdf4f7b-7f08-4095-9629-a1785bb679f2 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.154432] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.154668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.155151] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.155391] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fdf4f7b-7f08-4095-9629-a1785bb679f2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.171873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.172151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.172261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.172648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.172806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.173099] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.173291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.173340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.173542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.173661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.173794] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a already deleted. [ 738.173902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.293642] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.293827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.293877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.294172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.294273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.294375] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 738.333171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.333402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.333402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.333604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.333738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.356241] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 738.658372] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.658643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.658795] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.659119] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.659276] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.659429] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 2fdf4f7b-7f08-4095-9629-a1785bb679f2 not found, creating... [ 738.659691] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.659845] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.659957] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.660200] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.660333] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.660616] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.660763] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.660894] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.661133] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.661268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.661402] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 2fdf4f7b-7f08-4095-9629-a1785bb679f2 is going to be created. [ 738.689916] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.690334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.690334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.690502] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.690720] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.691057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.220271] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 739.220510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.220685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.220926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.221027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.317779] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.317779] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.317779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.319425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.319906] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [req-833e646e-d651-477e-a9dc-fbc7d2fe2f50 req-4d54d320-6207-4067-88cc-74cbd598736b service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [req-833e646e-d651-477e-a9dc-fbc7d2fe2f50 req-4d54d320-6207-4067-88cc-74cbd598736b service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [req-833e646e-d651-477e-a9dc-fbc7d2fe2f50 req-4d54d320-6207-4067-88cc-74cbd598736b service nova] Enqueued Resource ID: 2fdf4f7b-7f08-4095-9629-a1785bb679f2 with Priority: HIGHEST for action port [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 739.409308] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdf4f7b-7f08-4095-9629-a1785bb679f2 with Priority: HIGHEST for action port [ 739.409308] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.410360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.410656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.411293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.411880] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.414799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.414799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.414799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.414799] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.419996] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fdf4f7b-7f08-4095-9629-a1785bb679f2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.422711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.422711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.422711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.422711] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fdf4f7b-7f08-4095-9629-a1785bb679f2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.723822] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.724166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.724166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.724303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.724511] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.724602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.724657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.724809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.724892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.725056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.725090] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.827127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.827127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.827127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.827127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.828135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.828173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.828899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.828899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.828899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.828899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.828899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.828899] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.923339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.923469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.924371] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.926394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fdf4f7b-7f08-4095-9629-a1785bb679f2 with status ACTIVE [ 739.926394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.926552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.926552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.927449] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.927449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.928457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.928457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.928457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.928457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.928457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.928457] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fdf4f7b-7f08-4095-9629-a1785bb679f2 is going to be updated. [ 739.951800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.951996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.951996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.952213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.952396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.952533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fdf4f7b-7f08-4095-9629-a1785bb679f2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.172271] env[65231]: INFO networking_nsxv3.common.synchronization [req-099dde06-0bea-4e5a-b1e6-eee08a43bf30 req-25a0acc8-4f68-45d5-82bf-6353ef05f05a tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 740.172888] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 740.173262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.173399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.173468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.173676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.173867] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.174196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.174309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.174691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.174691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.174691] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.229997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.229997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.229997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.229997] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.229997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.230946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.230946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.230946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.230946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.230946] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.335472] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 740.355456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.356234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.356234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.356234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.356234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.356433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.356751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.356751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.356819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.356851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.357058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.357153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.357216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.357391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.357459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.357646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.357758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.357818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.357978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.360495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.360584] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 740.373753] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 740.373996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.374723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.374723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.374922] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.377577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.377577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.377577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.377577] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.432024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.432024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.432024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.432024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.432024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.432024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.452533] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 740.629556] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.629742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.629861] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.630135] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.630391] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.630537] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.630646] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.630848] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.631034] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.631242] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.631351] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.631455] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.631554] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.631654] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.631750] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.631891] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.651931] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.652205] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.652338] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.652525] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.652985] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-60c34ea2-a484-4d9b-a126-e16ceb89ff68 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.653248] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.653382] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.653709] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.653841] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c34ea2-a484-4d9b-a126-e16ceb89ff68',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.677065] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.733785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc2e8f3b-861c-4ff7-a89a-56fa66584a5e: rpc.has_security_group_logging(os_id): False [ 740.763625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.763876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.763876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.764082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.764179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.764378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.764483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.764548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.764705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.764786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.764979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.765099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.765146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.765399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.765399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.765569] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.765661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.765718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.765860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 740.839910] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.840165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.840165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.840321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.840655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.857913] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 740.882065] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd: rpc.has_security_group_logging(os_id): False [ 740.904138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.904335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.904335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.904591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.904669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.904848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.904946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.905023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.905426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.905426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.905426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.905603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.905603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.905686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.905758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.905936] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.906041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.906102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.906247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.906341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.906427] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be created. [ 740.935754] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.935754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.935754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.935931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.936102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.936102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be created. [ 740.996239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.996930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.996930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.996930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.996930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.017887] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: UNINITIALIZED for 2s [ 741.030508] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.030693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.030774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.031027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.031235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.052957] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 741.156384] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.156645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.157510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.157821] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.157980] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.158708] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 60c34ea2-a484-4d9b-a126-e16ceb89ff68 not found, creating... [ 741.159035] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.159207] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.159313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.159567] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.159910] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.160232] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.160660] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.160788] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.161059] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.161385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.161785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 60c34ea2-a484-4d9b-a126-e16ceb89ff68 is going to be created. [ 741.178951] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.190709] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.190948] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.191060] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.191379] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.191642] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.191946] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.506075] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f4cc3c56-3e99-4ed2-9ae5-ca77a523fb7d None None] Enqueued Resource ID: b48744e0-9e68-4d1a-8580-a1625c5ea01d with Priority: HIGHEST for action port [ 741.506365] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b48744e0-9e68-4d1a-8580-a1625c5ea01d with Priority: HIGHEST for action port [ 741.506913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b48744e0-9e68-4d1a-8580-a1625c5ea01d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.507050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b48744e0-9e68-4d1a-8580-a1625c5ea01d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.507117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b48744e0-9e68-4d1a-8580-a1625c5ea01d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.507376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b48744e0-9e68-4d1a-8580-a1625c5ea01d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.507457] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b48744e0-9e68-4d1a-8580-a1625c5ea01d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.684194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.684194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.684194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.684194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.684194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.684194] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 741.742641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.743277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.743277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.743277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.743277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.755863] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 741.875855] env[65231]: INFO networking_nsxv3.common.synchronization [req-099dde06-0bea-4e5a-b1e6-eee08a43bf30 req-7f585e06-adca-4bd5-9b39-e5dda914c015 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 741.876100] env[65231]: INFO networking_nsxv3.common.synchronization [req-099dde06-0bea-4e5a-b1e6-eee08a43bf30 req-7f585e06-adca-4bd5-9b39-e5dda914c015 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 741.876259] env[65231]: INFO networking_nsxv3.common.synchronization [req-099dde06-0bea-4e5a-b1e6-eee08a43bf30 req-7f585e06-adca-4bd5-9b39-e5dda914c015 service nova] Enqueued Resource ID: 60c34ea2-a484-4d9b-a126-e16ceb89ff68 with Priority: HIGHEST for action port [ 741.876817] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 741.877462] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 741.877617] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c34ea2-a484-4d9b-a126-e16ceb89ff68 with Priority: HIGHEST for action port [ 741.877935] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.878127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.878227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.878506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.878783] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.880308] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.880469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.880720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-60c34ea2-a484-4d9b-a126-e16ceb89ff68 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.880858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.881066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.881323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.885988] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c34ea2-a484-4d9b-a126-e16ceb89ff68',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.010087] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b48744e0-9e68-4d1a-8580-a1625c5ea01d [ 742.010550] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.010986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.010986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.011310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.011310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.011431] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b48744e0-9e68-4d1a-8580-a1625c5ea01d already deleted. [ 742.011490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b48744e0-9e68-4d1a-8580-a1625c5ea01d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.323763] env[65231]: INFO networking_nsxv3.common.synchronization [req-f6074e44-297b-4daf-8f00-049dcbd85ae2 req-4369188f-5274-4890-80ec-f643dd5f7080 tempest-ServersAdminNegativeTestJSON-1762838769 tempest-ServersAdminNegativeTestJSON-1762838769-project-member] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 742.325021] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGHEST for action security_group_members [ 742.327456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.327456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.327456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.327456] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.385994] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.386127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.386336] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60c34ea2-a484-4d9b-a126-e16ceb89ff68 with status ACTIVE [ 742.386511] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.390056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.390056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.390056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.390056] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60c34ea2-a484-4d9b-a126-e16ceb89ff68 is going to be updated. [ 742.414347] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.414912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.414912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.414912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.415060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.415243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60c34ea2-a484-4d9b-a126-e16ceb89ff68" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.467616] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 742.467969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.762653] env[65231]: INFO networking_nsxv3.common.synchronization [req-565e1996-e41c-449c-af3b-eab87576f9f7 req-0eb857f2-4d0a-4557-95e7-63c11d0e9c4a tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 742.763676] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 742.764126] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.764279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.764384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.764639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.765141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.765141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.765141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.765522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.765522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.765522] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.828586] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.828761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.828818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.832079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.861040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.861146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.861348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.861431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.862067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.862067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.862067] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be updated. [ 742.896555] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 742.896789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.918090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.918288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.918364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.918587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.918734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.938752] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: IN_PROGRESS for 2s [ 743.033999] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 743.033999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.033999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.033999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.034973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.034973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.034973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.034973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.034973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034973] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.065961] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 743.066268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.066398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.066776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.066776] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.163780] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.163973] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.164281] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.164387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.165557] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.165726] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.165840] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.166127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.166290] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.166821] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.166940] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.167057] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.167160] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.167265] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.167364] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.167487] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.188361] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.188514] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.188647] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.188815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.189236] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-82e10d00-0e3c-45ff-8eb0-94c860b50b97 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.189422] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.189559] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.189887] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.189999] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e10d00-0e3c-45ff-8eb0-94c860b50b97',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.268174] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.536787] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.537039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.537039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.537425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.537671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.538676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.538676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.539128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.539128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.539128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.539250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.539302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.539414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.539507] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.571202] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.571450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.571522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.571680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.571857] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.571978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.572062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.572219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.572308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.572394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.572484] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.692524] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.692762] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.693369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.693369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.693490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.693739] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 82e10d00-0e3c-45ff-8eb0-94c860b50b97 not found, creating... [ 743.693833] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.693967] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.694099] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.694322] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.694475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.694769] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.694923] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.697382] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.697622] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.697791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.697958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 82e10d00-0e3c-45ff-8eb0-94c860b50b97 is going to be created. [ 743.737172] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.737677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.737677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.738008] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.738363] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.738607] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.768069] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 743.768861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.768861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.768861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.768861] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.769561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.769561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.769561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.769561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.769561] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.770439] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.042782] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 744.062385] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.062580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.062627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.062834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.062922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.063163] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.063279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.063359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.063517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.063594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.063791] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.063924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.063973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.064109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.064186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.064389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.064485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.064563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.064706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.064783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.064884] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be created. [ 744.075015] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.075210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.075258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.075448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.075629] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.075746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.075817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.075998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.076154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.076236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.076860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.076860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.076860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.076860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.076860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.077201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.077201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.077201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.077376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.077376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.077467] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.137933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.138273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.138367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.139611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.139611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.150549] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 744.217810] env[65231]: INFO networking_nsxv3.common.synchronization [None req-598456ff-02fa-46c6-843e-daceced6b016 None None] Enqueued Resource ID: 412ce284-b6d3-4af7-b783-c967fcb484d3 with Priority: HIGHEST for action port [ 744.219090] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ce284-b6d3-4af7-b783-c967fcb484d3 with Priority: HIGHEST for action port [ 744.219517] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-412ce284-b6d3-4af7-b783-c967fcb484d3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.219703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-412ce284-b6d3-4af7-b783-c967fcb484d3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.219812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-412ce284-b6d3-4af7-b783-c967fcb484d3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.220205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-412ce284-b6d3-4af7-b783-c967fcb484d3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.220264] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412ce284-b6d3-4af7-b783-c967fcb484d3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.272976] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.274071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.274071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.274071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.274908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.274908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.274908] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 744.337973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.337973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.337973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.337973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.337973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.351983] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 744.477990] env[65231]: INFO networking_nsxv3.common.synchronization [req-565e1996-e41c-449c-af3b-eab87576f9f7 req-ff9298ed-61f6-4381-94b2-4c3bd7e2b0fd service nova] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_rules [ 744.477990] env[65231]: INFO networking_nsxv3.common.synchronization [req-565e1996-e41c-449c-af3b-eab87576f9f7 req-ff9298ed-61f6-4381-94b2-4c3bd7e2b0fd service nova] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 744.477990] env[65231]: INFO networking_nsxv3.common.synchronization [req-565e1996-e41c-449c-af3b-eab87576f9f7 req-ff9298ed-61f6-4381-94b2-4c3bd7e2b0fd service nova] Enqueued Resource ID: 82e10d00-0e3c-45ff-8eb0-94c860b50b97 with Priority: HIGHEST for action port [ 744.478370] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_rules [ 744.478547] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 744.478646] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e10d00-0e3c-45ff-8eb0-94c860b50b97 with Priority: HIGHEST for action port [ 744.478951] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.481723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.481804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.482287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.482406] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.483470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.483601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.483782] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e10d00-0e3c-45ff-8eb0-94c860b50b97 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.483886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.483943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.484190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.484277] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e10d00-0e3c-45ff-8eb0-94c860b50b97',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.580373] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd: rpc.has_security_group_logging(os_id): False [ 744.622570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.622570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.622570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.622570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.622992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.622992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.622992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.624297] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.624297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.624297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.624538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.624538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.624538] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 744.723037] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 412ce284-b6d3-4af7-b783-c967fcb484d3 [ 744.724468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.724468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.724468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.724468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.724468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.724468] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:412ce284-b6d3-4af7-b783-c967fcb484d3 already deleted. [ 744.724468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-412ce284-b6d3-4af7-b783-c967fcb484d3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.754913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.755212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.755212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.755358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.755508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.774662] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 744.778595] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.951441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da07af9e-2db7-465e-9508-0c4801123c21 in Status: SUCCESS [ 744.951611] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da07af9e-2db7-465e-9508-0c4801123c21 deletion is rescheduled due to dependency. [ 744.951792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.987424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.987569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.987775] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82e10d00-0e3c-45ff-8eb0-94c860b50b97 with status ACTIVE [ 744.988142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.988142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.988142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.988679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.988679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.988679] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.988679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.988883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.988937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.989241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.989241] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.989479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.989479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.989479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.989559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.989627] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82e10d00-0e3c-45ff-8eb0-94c860b50b97 is going to be updated. [ 745.024379] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.024547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.024595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.024853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.024998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.025181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e10d00-0e3c-45ff-8eb0-94c860b50b97" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.283030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.283030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.283030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.283030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.283322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.283322] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 745.313298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.313475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.313553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.313786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.313944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.325677] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 746.167926] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 746.168712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.363124] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 746.363392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.363570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.363825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.364031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.364311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.364311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.364537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.364537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.364612] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.790116] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 746.790391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.870437] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.255819] env[65231]: INFO networking_nsxv3.common.synchronization [req-80dc6d22-5d9d-4f37-b704-b3b92bfdc723 req-1abb418f-7371-40cb-acfb-1b5b12f6028e tempest-VolumesAdminNegativeTest-272223446 tempest-VolumesAdminNegativeTest-272223446-project-member] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 747.256444] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 747.256840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.256992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.257057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.257335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.258630] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.258960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.258960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.259113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.259195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.259295] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.341024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.341024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.341024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.341495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.341495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.341495] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.375312] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.640026] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.640026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-851" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.640026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-851" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.640026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-851" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.640433] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.640788] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.641082] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.642049] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.642049] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.642049] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.642049] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.642049] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.642400] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.642505] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.642667] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.642851] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.662065] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.662369] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.662604] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.663236] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-851" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.663632] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-a76340bd-06b2-455a-9cdf-a4aac83acf8e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.663832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.663922] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.664260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.664393] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76340bd-06b2-455a-9cdf-a4aac83acf8e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.761328] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.761488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.761564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.761795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.761934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.762100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.762191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.762255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.762406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.762481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.762565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 already deleted. [ 747.762645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.844076] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.844322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.844379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.844673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.844914] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.845087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.845156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.845362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.845654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.845654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.845894] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.845975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.846058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.846195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.846400] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.846518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.846601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.846782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.846892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.846994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.847138] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.879083] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.879083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.879300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.879426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.879529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.879653] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 747.914897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.915210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.915210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.915668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.915668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.927643] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 748.167093] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.167325] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.167397] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.168356] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.168356] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.168356] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port a76340bd-06b2-455a-9cdf-a4aac83acf8e not found, creating... [ 748.168356] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.168588] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.168588] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.168772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.168862] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.169181] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.169354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.169462] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.170683] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.170683] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.170683] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: a76340bd-06b2-455a-9cdf-a4aac83acf8e is going to be created. [ 748.194662] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.194929] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.195022] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.195281] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.195520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.195761] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.334398] env[65231]: INFO networking_nsxv3.common.synchronization [req-ede98ea7-ad46-4354-8649-cfd8d6be81e5 req-53b09ef2-6ce9-4d95-8d53-d848dc87daf3 tempest-ServerRescueTestJSONUnderV235-955367140 tempest-ServerRescueTestJSONUnderV235-955367140-project-member] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 748.334935] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGHEST for action security_group_members [ 748.335250] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.335378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.335450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.335638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.335799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.335898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.335957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.336125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.336212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.336307] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.350630] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93d71ddd-aafd-4027-b22a-d8863fc345e7: rpc.has_security_group_logging(os_id): False [ 748.375142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.375334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.375378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.375561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.425959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.426292] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.426421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.426488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.426706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.426795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.427007] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.427121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.427194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.427343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.427422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.427604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.427701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.427764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.427906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.427988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.428124] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 748.520729] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.521022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.521022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.521280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.521397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.544822] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 748.839301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.839510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.839680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.839929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.840047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.840383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.840520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.840590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.840772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.840862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.840984] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be updated. [ 748.883923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.884164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.884164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.884378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.884533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.896812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: IN_PROGRESS for 2s [ 748.965343] env[65231]: INFO networking_nsxv3.common.synchronization [req-80dc6d22-5d9d-4f37-b704-b3b92bfdc723 req-5c34acf3-8a02-4b62-bef6-b1134582c47d service nova] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_rules [ 748.966937] env[65231]: INFO networking_nsxv3.common.synchronization [req-80dc6d22-5d9d-4f37-b704-b3b92bfdc723 req-5c34acf3-8a02-4b62-bef6-b1134582c47d service nova] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 748.966937] env[65231]: INFO networking_nsxv3.common.synchronization [req-80dc6d22-5d9d-4f37-b704-b3b92bfdc723 req-5c34acf3-8a02-4b62-bef6-b1134582c47d service nova] Enqueued Resource ID: a76340bd-06b2-455a-9cdf-a4aac83acf8e with Priority: HIGHEST for action port [ 748.968909] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_rules [ 748.969199] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 748.969590] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76340bd-06b2-455a-9cdf-a4aac83acf8e with Priority: HIGHEST for action port [ 748.969854] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.970065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.970189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.970587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.970725] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.973482] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.973719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.973798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.974106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.974359] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.974520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.974621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.974860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.976311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.976311] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.978077] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a76340bd-06b2-455a-9cdf-a4aac83acf8e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.978077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.978077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.978077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.978077] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76340bd-06b2-455a-9cdf-a4aac83acf8e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.478404] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.481358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.481358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.481358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a76340bd-06b2-455a-9cdf-a4aac83acf8e with status ACTIVE [ 749.481603] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.481673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.481793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.482096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.483173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.483173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.483173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.483173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.483173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.483173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.483576] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.483754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.483985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.484486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.484486] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a76340bd-06b2-455a-9cdf-a4aac83acf8e is going to be updated. [ 749.534552] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.534552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.534552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.534552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.534552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.534552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a76340bd-06b2-455a-9cdf-a4aac83acf8e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.642028] env[65231]: INFO networking_nsxv3.common.synchronization [req-79656eb3-d35a-48c9-8fb7-b4a6531c4877 req-7df14956-c7d4-4396-8672-a261be2300ad tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 749.642028] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 749.642028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.643298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.643527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.643816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.644104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.644317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.645838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.645838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.645838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.645838] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.939318] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 749.939318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.939318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.939578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.940010] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.940010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.940010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.941273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.941273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.941273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.941273] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.981714] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.147342] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.444533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.444925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.444925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.445145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.445194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.445321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.445321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.445536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.445639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.445715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.445863] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.445954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.446063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.446290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.446469] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.446574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.446634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.446778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.446860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.446944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.447155] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.485348] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.486198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.486198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.486198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.486198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.486401] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 is going to be created. [ 750.512489] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.512985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.514710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.514710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.514710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.527937] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: UNINITIALIZED for 2s [ 750.562243] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 750.562691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.651350] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.911058] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e in Status: SUCCESS [ 750.911284] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e deletion is rescheduled due to dependency. [ 750.911438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.950770] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0: rpc.has_security_group_logging(os_id): False [ 750.973087] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.973302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.973427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.973803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.978552] env[65231]: INFO networking_nsxv3.common.synchronization [req-08f1b5f2-1e04-4f64-a28f-235ebc81b6f1 req-bb94e963-e4bd-4a94-a47e-f9c994c04dfa tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 750.979220] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 750.979605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.979681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.997350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.998490] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.998490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.998490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.998490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.998490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.998698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.998794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.998912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.999246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.999488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.999798] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.999913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.999980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.000144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.000246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.000333] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 751.072962] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.072962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.072962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.074837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.074837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.094970] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 751.152662] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.152872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.152872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.153124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.153220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.153334] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 751.199943] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.200140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.200239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.200519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.200720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.212877] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 752.539085] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: SUCCESS [ 752.539370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.539583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.539913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.540753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.540753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.540753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.540753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.540753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.540753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.540753] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.043066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.043244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.043311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.043752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.043935] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.044193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.044193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.044320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.044379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.044466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.044613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.044709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.044771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.044903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.045054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.045240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.045299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.045442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.045518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.045601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.045690] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.113021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 753.113021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.224367] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 753.224622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.225180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.225180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.225315] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.225585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.225585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.225787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.225870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.226039] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.548700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 869acb51-f00a-446a-b29b-f2bb797e9d19: rpc.has_security_group_logging(os_id): False [ 753.569249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.569402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.569531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.569734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.569835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.570136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.570136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.570301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.570387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.570450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.570640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.570806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.570806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.570944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.571075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.571276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.571370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.571433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.571577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.571661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.572986] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 is going to be created. [ 753.641925] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.642098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.642225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.642393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.642683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.659604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: IN_PROGRESS for 2s [ 753.728648] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.728893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.728893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.729185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.729290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.729491] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.729594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.729656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.729807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.729886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.729971] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 753.814535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.814535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.814535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.814535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.814535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.826669] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 754.396558] env[65231]: INFO networking_nsxv3.common.synchronization [req-c0957e6c-32a7-4795-ade5-90887e3b5a63 req-4c1ec084-abf9-4ee3-a82f-cec99b96ca41 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 754.397753] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 754.398139] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.398261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.398338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.398858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.398858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.398858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.399063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.399063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.399136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.399235] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.904364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.904364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.904364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.904364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.904364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.904364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.904364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.905336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.905336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.905336] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 754.935818] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.936080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.936080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.936198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.936460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.949496] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 755.674089] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: SUCCESS [ 755.674436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.839560] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 755.839560] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd deletion is rescheduled due to dependency. [ 755.839560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.961340] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 756.961683] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 deletion is rescheduled due to dependency. [ 756.961683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.991244] env[65231]: INFO networking_nsxv3.common.synchronization [req-8871d43f-c092-4166-9c7c-bd26129e1d21 req-18c151fd-0214-4ece-a94a-1ec3be797929 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 757.991244] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGHEST for action security_group_members [ 757.991244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.991244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.991244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.991840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.991840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.991840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.991840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.991840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.992672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.992672] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.095861] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 758.095861] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:1 started [ 758.498692] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.498692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.498692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.498692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.522887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.522887] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.522887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.522887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.523388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.523388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.523388] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf is going to be updated. [ 758.567404] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.567537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.567537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.567778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.567853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.581981] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: IN_PROGRESS for 2s [ 758.666719] env[65231]: INFO networking_nsxv3.common.synchronization [req-f80a9d06-cdc1-48dd-98ab-10bcbf242742 req-d5b24d4e-8255-4df2-8e6c-efb10adb1a4d tempest-FloatingIPsAssociationTestJSON-1925842782 tempest-FloatingIPsAssociationTestJSON-1925842782-project-member] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 758.667495] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 758.668024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.668024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.668455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.668699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.669348] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.669348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.669348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.669348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.669348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.669576] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.172676] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.604595] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.604791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.604901] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.605217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.605479] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.605630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.605742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.605956] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.606308] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.606529] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.606677] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.606843] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.607030] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.607132] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.607221] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.607412] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.634305] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.634481] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.634613] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.634789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-903" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.635105] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-8f67dda7-eba8-461d-be5c-024326f46482 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.635273] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.635388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.635735] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.635872] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f67dda7-eba8-461d-be5c-024326f46482',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.676229] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.045270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.045442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.045514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.045742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.045858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.142228] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.142565] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.142985] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.143307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.143609] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.143816] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 8f67dda7-eba8-461d-be5c-024326f46482 not found, creating... [ 760.144288] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.144621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.144852] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.145294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.145536] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.146047] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.146383] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.146580] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.147014] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.147285] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.147515] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 8f67dda7-eba8-461d-be5c-024326f46482 is going to be created. [ 760.175839] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.176255] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.176440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.176766] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.176968] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.177322] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.179382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.179519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.180075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.180075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.180075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.180258] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 760.212699] env[65231]: INFO networking_nsxv3.common.synchronization [req-89fd82b9-abcb-402b-8deb-3f96ecc04659 req-b05b88d7-5139-450c-8bd2-9e3d1d3c68b8 tempest-FloatingIPsAssociationNegativeTestJSON-1419473329 tempest-FloatingIPsAssociationNegativeTestJSON-1419473329-project-member] Enqueued Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 760.213770] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGHEST for action security_group_members [ 760.214784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.214908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.214975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.215256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.215700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.215700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.215848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.215959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.216067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.216192] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.219853] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.219853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.219853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.219853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.219853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.305419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 760.550278] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.592910] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf in Status: SUCCESS [ 760.593222] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf deletion is rescheduled due to dependency. [ 760.593222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.718822] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.720963] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.720963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.720963] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 is going to be updated. [ 760.761426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.761426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.761560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.761968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.761968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.772975] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: IN_PROGRESS for 2s [ 760.942313] env[65231]: INFO networking_nsxv3.common.synchronization [req-f80a9d06-cdc1-48dd-98ab-10bcbf242742 req-debc4303-f5d0-4a75-a422-3225803ab9fa service nova] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_rules [ 760.942504] env[65231]: INFO networking_nsxv3.common.synchronization [req-f80a9d06-cdc1-48dd-98ab-10bcbf242742 req-debc4303-f5d0-4a75-a422-3225803ab9fa service nova] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 760.942658] env[65231]: INFO networking_nsxv3.common.synchronization [req-f80a9d06-cdc1-48dd-98ab-10bcbf242742 req-debc4303-f5d0-4a75-a422-3225803ab9fa service nova] Enqueued Resource ID: 8f67dda7-eba8-461d-be5c-024326f46482 with Priority: HIGHEST for action port [ 760.943195] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_rules [ 760.943340] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 760.943543] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f67dda7-eba8-461d-be5c-024326f46482 with Priority: HIGHEST for action port [ 760.943694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.943820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.943886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.944115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.944203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.945061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.945168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.945378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f67dda7-eba8-461d-be5c-024326f46482 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.945480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.945543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.945719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.945794] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f67dda7-eba8-461d-be5c-024326f46482',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.053347] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.372705] env[65231]: INFO networking_nsxv3.common.synchronization [req-676fac28-5c45-4c00-94d1-dec05e7ebb52 req-cf529a85-dc2c-40e1-a6f9-d787e30b3255 tempest-InstanceActionsTestJSON-505457236 tempest-InstanceActionsTestJSON-505457236-project-member] Enqueued Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 761.373779] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 761.373779] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.373779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.374016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.374933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.374933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.375096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.375207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.375420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.375918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.376114] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.448274] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.448274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.448441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f67dda7-eba8-461d-be5c-024326f46482 with status ACTIVE [ 761.448662] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.448790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.448790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.448966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.449105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.449300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.449395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.449472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.449656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.449738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.449933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.450915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.450915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.450915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.450915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.450915] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f67dda7-eba8-461d-be5c-024326f46482 is going to be updated. [ 761.475722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.475945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.476043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.476313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.476581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.476754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f67dda7-eba8-461d-be5c-024326f46482" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.556527] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 761.556527] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 761.786029] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.786029] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-886" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-886" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-886" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.787386] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.787386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.788339] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.788339] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.788443] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.789666] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.789666] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.789666] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.789666] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.812788] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.812788] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.812788] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.812788] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-886" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.813152] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.813338] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.813504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.813819] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.813949] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23536c4b-79d7-4ddf-a5a4-cc81015fc98e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.878029] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.878029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.878205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.878321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.878420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.878619] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.878721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.878779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.879546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.879546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.879546] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 already deleted. [ 761.879546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.315296] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 762.315526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.315694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.315974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.316189] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.316314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.316407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.316577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.316658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.316753] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.319021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.319229] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.319355] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.319585] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.319724] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.319867] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 23536c4b-79d7-4ddf-a5a4-cc81015fc98e not found, creating... [ 762.320145] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.320576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.320576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.320755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.320928] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.321281] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.321433] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.321549] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.321832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.321966] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.322154] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 23536c4b-79d7-4ddf-a5a4-cc81015fc98e is going to be created. [ 762.341768] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.341993] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.342146] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.342547] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.342813] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.343097] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.448128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.448453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.448535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.448756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.463486] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 762.464918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.465705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 762.501206] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.501206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.501206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.501206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.508991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.509712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 762.509944] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 762.510144] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 762.567524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.567698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.567770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.568014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.569024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.570369] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 762.685192] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.685403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.685403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.685740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.686059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.686503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 762.777721] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.778885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.778885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.778885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.779158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.780331] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 762.780422] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ef5784cc-7357-491d-87fc-9e86cfa66f0a', '3fbc0c08-a13f-4d85-8260-308f219683bb', '8484bf59-35bd-4576-8ebe-fc2e1520b057', 'dc2e8f3b-861c-4ff7-a89a-56fa66584a5e', '07ae4197-f0b5-42cc-83f2-b8f0bb199776', 'cdb04723-8209-4d79-9e38-c5a195883f28', '17657ce0-a2c9-466c-a6c4-c2a07aab6fd0', '848d2bc8-86fa-42f2-8986-0a1fae12ae1b', 'c15aec1a-6b31-4260-9fa5-1dd741dd95c5', 'e84a3002-4115-443b-93ae-8ea2f36a04a2', '86b6679c-89d1-48f3-bc4c-125e7f8f71df', '070cab8d-4383-4e42-847f-e29c9f10471f', '4627e60c-b048-4d11-9490-0fc87e114ba8', '1e393dd1-1dbb-41d4-9493-ce5a0a66aadf', '958c3ba3-f0b2-4eeb-830e-ed8b206a3477', 'cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3', '1f698486-5433-4f5d-838f-8989284e2ed7', '93d71ddd-aafd-4027-b22a-d8863fc345e7', 'da07af9e-2db7-465e-9508-0c4801123c21', '869acb51-f00a-446a-b29b-f2bb797e9d19', 'd76eb4ea-4e07-4f87-8e4f-58cae3b3eccd', '048f7577-8ddf-44da-9165-34de6c108c3b', '9389aaed-1ad6-48d4-af15-236c6a035cba', '089102e4-f74e-4139-88d6-a79e9f27e9c1', 'e78acfd0-0636-44da-8f92-638d0b04c956', '01685928-70c6-4a4e-8584-3fbdbe9910e3', 'ee4dd131-77b2-4914-aa5f-9f4b5de030a2', '1bcea4e4-2c8c-4878-89e4-515969ca794c', '815e1e30-e3ab-42b0-b86b-fcd2a81435a2', '8b152afd-9129-4bd3-b47d-6533ebe5e687', 'cee33745-1169-4666-835e-545451997389', '8c7c7dcc-21d1-45b3-b34e-4d29c652aefb', 'b384100c-460b-4c13-8f1d-ec90af9ef06d', '891aab68-a374-48cb-ac40-546cb8e3fe02'} {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 762.780527] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 762.792302] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 in Status: SUCCESS [ 762.792505] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 deletion is rescheduled due to dependency. [ 762.792665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.807545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.807834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.807834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.808125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.808494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.808494] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 762.808494] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 762.808718] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 762.825799] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.875381] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.876084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.876170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.876389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.877136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.877419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 762.877560] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 762.877654] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 762.877725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 762.877805] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 762.877878] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 762.877957] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGH for action security_group_rules [ 762.878049] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGH for action security_group_rules [ 762.878119] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGH for action security_group_rules [ 762.878182] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 762.878243] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGH for action security_group_rules [ 762.878304] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGH for action security_group_rules [ 762.878443] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGH for action security_group_rules [ 762.878443] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGH for action security_group_rules [ 762.878543] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 762.878596] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGH for action security_group_rules [ 762.878658] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGH for action security_group_rules [ 762.878725] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGH for action security_group_rules [ 762.878772] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGH for action security_group_rules [ 762.878832] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGH for action security_group_rules [ 762.878892] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGH for action security_group_rules [ 762.878970] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 762.879075] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGH for action security_group_rules [ 762.879141] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGH for action security_group_rules [ 762.879203] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGH for action security_group_rules [ 762.879304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.092445] env[65231]: INFO networking_nsxv3.common.synchronization [req-676fac28-5c45-4c00-94d1-dec05e7ebb52 req-4d1747bc-2e65-438e-922c-e7d4f541374c service nova] Enqueued Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_rules [ 763.092445] env[65231]: INFO networking_nsxv3.common.synchronization [req-676fac28-5c45-4c00-94d1-dec05e7ebb52 req-4d1747bc-2e65-438e-922c-e7d4f541374c service nova] Enqueued Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 763.092445] env[65231]: INFO networking_nsxv3.common.synchronization [req-676fac28-5c45-4c00-94d1-dec05e7ebb52 req-4d1747bc-2e65-438e-922c-e7d4f541374c service nova] Enqueued Resource ID: 23536c4b-79d7-4ddf-a5a4-cc81015fc98e with Priority: HIGHEST for action port [ 763.093276] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_rules [ 763.093276] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 763.093276] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23536c4b-79d7-4ddf-a5a4-cc81015fc98e with Priority: HIGHEST for action port [ 763.093472] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 763.093547] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGH for action security_group_rules [ 763.093660] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGH for action security_group_rules [ 763.093747] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 with Priority: HIGH for action security_group_rules [ 763.094130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGH for action security_group_rules [ 763.094130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da07af9e-2db7-465e-9508-0c4801123c21 with Priority: HIGH for action security_group_rules [ 763.094130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGH for action security_group_rules [ 763.094130] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 763.094449] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf with Priority: HIGH for action security_group_rules [ 763.094449] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGH for action security_group_rules [ 763.094545] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 with Priority: HIGH for action security_group_rules [ 763.094655] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070cab8d-4383-4e42-847f-e29c9f10471f with Priority: HIGH for action security_group_rules [ 763.094781] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGH for action security_group_rules [ 763.094900] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 763.095019] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGH for action security_group_rules [ 763.095172] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb04723-8209-4d79-9e38-c5a195883f28 with Priority: HIGH for action security_group_rules [ 763.095312] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGH for action security_group_rules [ 763.095421] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 763.095525] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbc0c08-a13f-4d85-8260-308f219683bb with Priority: HIGH for action security_group_rules [ 763.095650] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e with Priority: HIGH for action security_group_rules [ 763.096024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.096196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.096267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.096577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.096685] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.098185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.098858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.098858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.098858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.099476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.101363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.101363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.101363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.101363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.101363] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.101363] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.101363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.101694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.101694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.101694] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23536c4b-79d7-4ddf-a5a4-cc81015fc98e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.102449] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.102651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.102722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.102864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.103411] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.105288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.106133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.106133] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.106133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.106133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.106133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.106133] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.107428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.107520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.107596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.107736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.107813] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('958c3ba3-f0b2-4eeb-830e-ed8b206a3477',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.109152] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.109440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.109440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.109502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.109536] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.110736] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da07af9e-2db7-465e-9508-0c4801123c21 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.110861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.110983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.111176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.111314] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da07af9e-2db7-465e-9508-0c4801123c21',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.116024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.116024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.116024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.116024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.116024] env[65231]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 763.116024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.116024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.116024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e393dd1-1dbb-41d4-9493-ce5a0a66aadf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.118543] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.118629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.118689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.118804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.118986] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.121422] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4627e60c-b048-4d11-9490-0fc87e114ba8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.121590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.121661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.121929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.121929] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4627e60c-b048-4d11-9490-0fc87e114ba8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.123409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070cab8d-4383-4e42-847f-e29c9f10471f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.123569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.123675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.123920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.124059] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070cab8d-4383-4e42-847f-e29c9f10471f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.125705] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.125821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.125899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.126060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.126134] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.127520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.128587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.128587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.128587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.128587] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.129146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.129146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.129146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.129399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.129399] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.130180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdb04723-8209-4d79-9e38-c5a195883f28 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.130291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.130342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.130961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.130961] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdb04723-8209-4d79-9e38-c5a195883f28',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.131581] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.131688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.131768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.131916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.131988] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.132868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.132967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.133081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.133194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.133521] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.133521] env[65231]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 763.134186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fbc0c08-a13f-4d85-8260-308f219683bb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.134418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.134558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.134603] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fbc0c08-a13f-4d85-8260-308f219683bb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.137867] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.137867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.137867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.137867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.137867] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc2e8f3b-861c-4ff7-a89a-56fa66584a5e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.143550] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.144542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.328452] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.640469] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23536c4b-79d7-4ddf-a5a4-cc81015fc98e with status ACTIVE [ 763.643876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.643876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.643876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.643876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.643876] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23536c4b-79d7-4ddf-a5a4-cc81015fc98e is going to be updated. [ 763.647037] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.670932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.671128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.671206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.671440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.671571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.672191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23536c4b-79d7-4ddf-a5a4-cc81015fc98e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.672191] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.672361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.672361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.672449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.672823] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.673714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.673846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.674126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.674368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.674368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.674474] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.675523] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.675658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.675757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.675937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.676121] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.676247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.676285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.676727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.676727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.676727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.676727] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.677611] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.677744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.677816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.677989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.678242] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.678314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.678348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.678513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.678592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.678710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.678800] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.683022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.683145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.683223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.683421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.683611] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.683714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.683774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.687642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.687642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.687642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.687642] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.688556] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.688837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.688837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.689085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.689304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.690826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.691014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.691193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.691324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.691439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.691582] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.695688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.695688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.697284] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.697284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.697284] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.705270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.705543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.705543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.705651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.705808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.705897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.705972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.709811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.710741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.710741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.710741] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.718640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.718765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.718831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.719081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.719298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.719500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.722258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.722258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.722258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.722258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.722258] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.724971] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.725180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.725180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.725394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.725571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.725685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.725741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.725845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.725929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.726116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.726212] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.726321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.726373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.726473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.726619] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.726706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.726840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.726908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.726966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.727048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.727726] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.733517] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.735433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.735581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.735650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.735852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.736088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.736151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.736212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.736505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.736505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.736505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.736686] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.737604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.737775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.737775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.738077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.738164] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.738485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.738485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.738485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.742043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.742043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.742043] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.785314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.785669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.785669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.785823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.787763] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.787940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.791185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.791185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.792267] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.792267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.792771] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.792961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.794055] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.794055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.797775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.797886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.798872] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.798872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.800411] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.800521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.817992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.818123] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdb04723-8209-4d79-9e38-c5a195883f28 is going to be deleted. [ 763.819444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.819659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.830780] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.830954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.831403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.831403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.831637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.831637] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 763.849530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.849816] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4627e60c-b048-4d11-9490-0fc87e114ba8 is going to be deleted. [ 763.851643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.851643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.880174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.880556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e393dd1-1dbb-41d4-9493-ce5a0a66aadf is going to be deleted. [ 763.883066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.883066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.886265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.886532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.886779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.887151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.887455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.906954] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 763.942581] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.945035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.945181] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070cab8d-4383-4e42-847f-e29c9f10471f is going to be deleted. [ 763.946767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.947134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.949824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.950045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.991332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.991477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fbc0c08-a13f-4d85-8260-308f219683bb is going to be deleted. [ 763.993119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.993119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.026400] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.026530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.031747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.031903] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be deleted. [ 764.033085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.033280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.064500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.064798] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 958c3ba3-f0b2-4eeb-830e-ed8b206a3477 is going to be deleted. [ 764.065939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.066233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.068659] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.068659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.111924] env[65231]: INFO networking_nsxv3.common.synchronization [req-910be6ee-7f75-4cde-9d82-77f54f8c3091 req-352f135b-d612-45aa-b2c2-efdcd715e3e4 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 764.113037] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 764.113711] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.113962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.114102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.114448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.114710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.114982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.115199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.115389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.116049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.116049] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.131914] env[65231]: INFO networking_nsxv3.common.synchronization [req-1264b40e-45c8-42a7-920b-cb116e06b00a req-a5f622a3-0c42-4845-994d-00233e28ece8 tempest-VolumesAdminNegativeTest-272223446 tempest-VolumesAdminNegativeTest-272223446-project-member] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 764.133015] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGHEST for action security_group_members [ 764.134953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.134953] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da07af9e-2db7-465e-9508-0c4801123c21 is going to be deleted. [ 764.136295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.136501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.136619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.136906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.137547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.137667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.137731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.137918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.138052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.138159] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.139406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.139904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.149130] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.180170] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.180170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.184039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.184039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.184039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.184422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.184422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.184536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.184567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.184936] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.184936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.184936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.185200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.185200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.185280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.185316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.185462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.185538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.185619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.185713] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.186854] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.187049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.187211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.187356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.187471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.187572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.187665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.187736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.187924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.188034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.188141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.188202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.188431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.188552] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.188652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.188708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.188855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.188978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.189073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.189187] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.190884] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.191023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.192534] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.192633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.201795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.202099] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc2e8f3b-861c-4ff7-a89a-56fa66584a5e is going to be deleted. [ 764.203675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.204058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.204209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.204438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdb04723-8209-4d79-9e38-c5a195883f28" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.205660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.205660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.205660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.205841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4627e60c-b048-4d11-9490-0fc87e114ba8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.206461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.206669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.207679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.207679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e393dd1-1dbb-41d4-9493-ce5a0a66aadf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.207679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.207679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.207679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.207918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070cab8d-4383-4e42-847f-e29c9f10471f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fbc0c08-a13f-4d85-8260-308f219683bb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.209269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.209537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.209537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-958c3ba3-f0b2-4eeb-830e-ed8b206a3477" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.210135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.210364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.210497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.210642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.228863] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.229059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.229766] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.230221] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.241746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0: rpc.has_security_group_logging(os_id): False [ 764.243144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.243258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.243337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.243555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.243721] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.243819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.243882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.244035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.244141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.244205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.244514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.244514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.244514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.244624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.244735] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.244872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.244872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.245026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.245079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.245161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.245247] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.247164] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.247282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.247332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.247496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.248207] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.248207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.248207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.248207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.248207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.249371] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.249371] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.249371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.249744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.249744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.249744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.249744] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.250723] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c15aec1a-6b31-4260-9fa5-1dd741dd95c5: rpc.has_security_group_logging(os_id): False [ 764.252338] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.288669] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.288881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.288881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.289199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.310056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.310261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.318738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.319431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.319431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.319686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.319917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.320093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.320200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 764.324525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.324817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.355816] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.355943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.356817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.356988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.378073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.378461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.378598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.378598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.378768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.378847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.379096] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.379202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.380030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.380030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.380355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 764.381293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.381465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.381551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.381678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da07af9e-2db7-465e-9508-0c4801123c21" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.381831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.381985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.382080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.382194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc2e8f3b-861c-4ff7-a89a-56fa66584a5e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.527343] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.527343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.527343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.527343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.527343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.591368] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 764.596186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.596186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.596445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.596486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.596618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.616209] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-426 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.616772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.616772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.617076] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.617437] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.617641] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.617763] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.618013] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.618235] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.618380] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.618536] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.618849] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.618849] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.618849] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.619095] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.619355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.625146] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.642171] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 764.642535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.642628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.642699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.642902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.653825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.656902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.656902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.656902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.656902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.656902] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 is going to be created. [ 764.684134] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.684330] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.065 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.684485] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.684671] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-426" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.685010] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-13532539-db1b-4886-aa80-78174f3326ff taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.685188] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.685335] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.685664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.685804] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13532539-db1b-4886-aa80-78174f3326ff',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.689037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.689304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.689614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.689614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.689683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.690356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.690356] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 is going to be updated. [ 764.694513] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 764.695314] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3: rpc.has_security_group_logging(os_id): False [ 764.699105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.699105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.699105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.699386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.699386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.733118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 764.733974] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d2bc8-86fa-42f2-8986-0a1fae12ae1b: rpc.has_security_group_logging(os_id): False [ 764.744243] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: UNINITIALIZED for 2s [ 764.752591] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93d71ddd-aafd-4027-b22a-d8863fc345e7: rpc.has_security_group_logging(os_id): False [ 764.754600] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 764.755773] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86b6679c-89d1-48f3-bc4c-125e7f8f71df: rpc.has_security_group_logging(os_id): False [ 764.787398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.787623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.787623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.787950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.791586] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.791586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.792751] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.792751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.794338] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.794442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.795772] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.795903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.796724] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.796827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.811559] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.811719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.838764] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.838941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.838990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.839233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.839368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.841275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.841515] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.841617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.841683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.841872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.841940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.842148] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.842238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.842296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.842444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.842518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.842712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.842781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.842842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.842979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.843066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.843219] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 is going to be updated. [ 764.844213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.844390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.869734] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: IN_PROGRESS for 2s [ 764.879780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.880143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.880923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.880923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.880923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.880923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.880923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.880923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.881363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.881493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.881529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.881778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.881877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.881950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.882271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.882798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.882798] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 764.883784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.883853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.928212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.928500] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.928666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.928779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.928951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.929050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.929158] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 764.930504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.930756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.960508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.960798] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.960922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.960989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.961274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.961354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.961563] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.961665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.961727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.961875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.962011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.962222] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.962343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.962409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.962560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.962637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.962732] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 764.963914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.964031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.966041] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.966204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.992731] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.992865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.009611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.010372] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.010372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.010527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.010754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.010875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.011109] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b is going to be updated. [ 765.166991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.167278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.168542] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.172635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.172635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.173613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.173613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.198518] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.198731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.198853] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.199204] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.199362] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.199515] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 13532539-db1b-4886-aa80-78174f3326ff not found, creating... [ 765.199781] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.199939] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.200066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.201090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.201090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.201090] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.201090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.201090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.201520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.201520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.201520] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 13532539-db1b-4886-aa80-78174f3326ff is going to be created. [ 765.225823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.226148] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.226246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.226321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.227154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.227154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.227154] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 765.227829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.228049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.228355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.229327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.229614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.232050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.232050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.232050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.234244] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.234495] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.234648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.234946] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.235315] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.236041] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.260635] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 765.261815] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: IN_PROGRESS for 2s [ 765.283578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.283914] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.284076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.284373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.287154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.287154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.287154] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 765.287154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.287723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.287723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.288504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.288657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.288788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.332450] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 765.333573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 765.389693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.389891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.389932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.390285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.390496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.398223] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.398384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.398384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.398746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.398976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.438814] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: IN_PROGRESS for 2s [ 765.438814] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 765.510591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.510747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.510819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.511088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.511271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.538659] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 765.675194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.675529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.675529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.675673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.675784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.675835] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 765.777590] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.777774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.777821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.778064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.778261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.804536] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 765.919029] env[65231]: INFO networking_nsxv3.common.synchronization [req-910be6ee-7f75-4cde-9d82-77f54f8c3091 req-e58ec1fd-3073-4c2d-b4df-db7ec67c79d9 service nova] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 765.919029] env[65231]: INFO networking_nsxv3.common.synchronization [req-910be6ee-7f75-4cde-9d82-77f54f8c3091 req-e58ec1fd-3073-4c2d-b4df-db7ec67c79d9 service nova] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 765.919029] env[65231]: INFO networking_nsxv3.common.synchronization [req-910be6ee-7f75-4cde-9d82-77f54f8c3091 req-e58ec1fd-3073-4c2d-b4df-db7ec67c79d9 service nova] Enqueued Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 765.919029] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 765.919029] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 765.919600] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 765.920100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.920426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.920587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.920867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.921051] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.922648] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.922648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.923103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-13532539-db1b-4886-aa80-78174f3326ff taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.923269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.923305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.923484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.923582] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13532539-db1b-4886-aa80-78174f3326ff',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.941999] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 765.942284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.943135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.943393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.943637] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.943778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.943910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.946703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.946703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.946703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.946703] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.426286] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.427904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.427904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13532539-db1b-4886-aa80-78174f3326ff with status ACTIVE [ 766.428078] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.428848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.428848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.429684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.429885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.430168] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.430317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.430390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.430598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.430678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.430991] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.431193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.431265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.431437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.431534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.432394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13532539-db1b-4886-aa80-78174f3326ff is going to be updated. [ 766.449284] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.449701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.449965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.450297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.450571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.450754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.450854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.451367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.451612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.451793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.452181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.452434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.452552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.452843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.453450] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.453652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.453802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.454077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.454259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.454437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.454614] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.457392] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.457695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.457855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.459092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.459355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.459617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.608453] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 766.608711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.658342] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 766.659072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.756865] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: SUCCESS [ 766.757402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.757402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.760283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.760283] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.760642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.760642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.760642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.760849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.760849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.762137] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.881173] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: SUCCESS [ 766.881372] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 deletion is rescheduled due to dependency. [ 766.881488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.881659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.881873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.882108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.882252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.882252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.882394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.882473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.882553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.882702] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.882794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.882852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.882986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.883131] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.883222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.883279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.883424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.883517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.883600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.883687] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.925827] env[65231]: INFO networking_nsxv3.common.synchronization [req-0127e5b8-382c-4b24-97a5-48ce973372f9 req-aae9b59e-bd99-475d-b25e-fb48361e9244 tempest-ListImageFiltersTestJSON-1168737775 tempest-ListImageFiltersTestJSON-1168737775-project-member] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 766.926461] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 766.926820] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.926969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.927591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.927591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.927711] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.927792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.928220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.928430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.928559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.928671] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.961898] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8484bf59-35bd-4576-8ebe-fc2e1520b057: rpc.has_security_group_logging(os_id): False [ 766.980561] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.980709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.980814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.980971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.003377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.003688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.003807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.003874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.004090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.004169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.004364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.004474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.004533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.004682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.004756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.004933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.005035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.005093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.005230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.005305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.005389] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 767.072014] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.072189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.072189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.072689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.072795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.097604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 767.264539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.264744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.264744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.264992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.266043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.266373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266645] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.266725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.266773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.267061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.267211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.267211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.267350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.267762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.267762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.267762] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.279721] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: SUCCESS [ 767.280401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.280748] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 767.280941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.306633] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.306823] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.306940] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.307255] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.307504] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.307663] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.307768] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.307978] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.308294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.308537] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.308644] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.308747] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.308848] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.308948] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.309070] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.309206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.328646] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.328908] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.329084] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.329266] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.329823] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-136d1f3d-e231-43db-be27-b5e32d468d01 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.329823] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.330051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.330253] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.330384] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136d1f3d-e231-43db-be27-b5e32d468d01',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.350898] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 767.351161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.352518] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 767.352725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.389938] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 869acb51-f00a-446a-b29b-f2bb797e9d19: rpc.has_security_group_logging(os_id): False [ 767.408730] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.408870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.408957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.411131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.411131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.412824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.412824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.412824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.413026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.413026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.413195] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.413392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.413392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.413499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.413556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.413735] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.413851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.413932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.413999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.414105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.414190] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 is going to be updated. [ 767.431875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.432111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.432201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.432481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.432644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.432926] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.433051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.433115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.433271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.433345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.433450] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 already deleted. [ 767.433551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.450915] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: SUCCESS [ 767.451212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.452040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 767.452226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.486452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.486601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.486737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.487702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.487702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.506581] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: IN_PROGRESS for 2s [ 767.562388] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 767.563523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.772073] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6430736-9ff5-460b-bc23-c5a9b4bcafe0: rpc.has_security_group_logging(os_id): False [ 767.793252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.793397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.794650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.794650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.794650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.795563] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.795563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.795563] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 is going to be created. [ 767.816130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 767.816386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.816571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.816827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.817049] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.817189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.817257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.817431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.817524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.817637] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.833176] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.833647] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.833882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.834268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.835142] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.839083] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 136d1f3d-e231-43db-be27-b5e32d468d01 not found, creating... [ 767.839599] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.839874] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.840264] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.840612] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.840803] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.841682] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.841682] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.841682] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.841889] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.841928] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.842371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 136d1f3d-e231-43db-be27-b5e32d468d01 is going to be created. [ 767.867066] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.867305] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.867428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.867710] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.867947] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.868190] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.870583] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.870720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.870790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.870983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.871207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.884634] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: IN_PROGRESS for 2s [ 768.321696] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.607575] env[65231]: INFO networking_nsxv3.common.synchronization [req-0127e5b8-382c-4b24-97a5-48ce973372f9 req-43e372ce-8087-40b7-a482-bfd8904a47c3 service nova] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_rules [ 768.607841] env[65231]: INFO networking_nsxv3.common.synchronization [req-0127e5b8-382c-4b24-97a5-48ce973372f9 req-43e372ce-8087-40b7-a482-bfd8904a47c3 service nova] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 768.608236] env[65231]: INFO networking_nsxv3.common.synchronization [req-0127e5b8-382c-4b24-97a5-48ce973372f9 req-43e372ce-8087-40b7-a482-bfd8904a47c3 service nova] Enqueued Resource ID: 136d1f3d-e231-43db-be27-b5e32d468d01 with Priority: HIGHEST for action port [ 768.608543] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_rules [ 768.608682] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 768.608778] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136d1f3d-e231-43db-be27-b5e32d468d01 with Priority: HIGHEST for action port [ 768.609138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.609261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.609261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.609506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.609585] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.610906] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.611061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.611189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.611452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.612085] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.612219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.612298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.612778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.612778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.612896] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.615049] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-136d1f3d-e231-43db-be27-b5e32d468d01 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.615217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.616468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.617942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.618086] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136d1f3d-e231-43db-be27-b5e32d468d01',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.823933] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.114415] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 769.114415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.114769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.114985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.115141] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.121193] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.122992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.122992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.123208] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 136d1f3d-e231-43db-be27-b5e32d468d01 with status ACTIVE [ 769.123633] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.123633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.123633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.123788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.124171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.126981] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.126981] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.126981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.128038] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 136d1f3d-e231-43db-be27-b5e32d468d01 is going to be updated. [ 769.156020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.156020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.156020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.156020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.156020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.156020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-136d1f3d-e231-43db-be27-b5e32d468d01" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.327336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.327711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.327993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.328497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.328724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.331148] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 769.360205] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.360205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.360205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.360600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.360600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.376929] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 769.523102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 in Status: SUCCESS [ 769.523358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.549408] env[65231]: INFO networking_nsxv3.common.synchronization [req-fcce1c95-f089-413b-a753-4801eec2fdab req-e743406f-a806-4c32-8e76-6b622402164f tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 769.550194] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 769.550546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.550675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.550739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.550959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.551147] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.551249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.551331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.551485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.551707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.551707] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.618486] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.618726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.619722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.619722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.619722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.619722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.619722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.620320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.620320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.620320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.620454] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.633682] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.898704] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: SUCCESS [ 769.899137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.054878] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.055078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.055147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.055501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.055534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.055737] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.055836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.055898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.056081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.056158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.056423] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 770.091066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.092325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.092325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.092325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.092325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.105384] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 770.123739] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.123739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.123867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.124222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.124321] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.124380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.125452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.125883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125883] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.125883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.125883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.126028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.127041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.127041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.127041] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.142196] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.142196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.142196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.142196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.142196] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be created. [ 770.167698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.167873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.167911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.168212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.168310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.178658] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: UNINITIALIZED for 2s [ 770.631355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8484bf59-35bd-4576-8ebe-fc2e1520b057: rpc.has_security_group_logging(os_id): False [ 770.654158] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.654373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.654491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.654733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.655428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.655660] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.655725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.655828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.656071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.656210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.656550] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.656728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.656867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.657155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.657330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.657611] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.657759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.657876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.659040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 770.757120] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.757326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.757436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.757957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.757957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.790707] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 771.389045] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 771.389333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.389490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390546] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.755293] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8f4adc8-a30f-4a8a-ab6e-f299d6c14c4a req-682fc755-78a6-4759-b46a-af94fed1bae8 tempest-ListImageFiltersTestJSON-1168737775 tempest-ListImageFiltersTestJSON-1168737775-project-member] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 771.755974] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 771.756481] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.756580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.894306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.894306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.894306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.895442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.895535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.895717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.895925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.895925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.896181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.896181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.896321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.896473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.896623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.897234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.897335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.897508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.898171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.898171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.898171] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.119585] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 772.119813] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 772.120183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.160544] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.160804] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.160970] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.161391] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.161703] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.161901] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.161999] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.162242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.162416] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.162660] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.162805] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.162890] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.162988] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.163105] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.163255] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.163540] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.182441] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0911b926-0970-4b30-a9af-ecd1e6b54cfc None None] Enqueued Resource ID: 4f975e44-e512-4536-b50d-ec5025360d87 with Priority: HIGHEST for action port [ 772.183050] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f975e44-e512-4536-b50d-ec5025360d87 with Priority: HIGHEST for action port [ 772.183846] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f975e44-e512-4536-b50d-ec5025360d87 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.183997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f975e44-e512-4536-b50d-ec5025360d87" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.184081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f975e44-e512-4536-b50d-ec5025360d87" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.184365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f975e44-e512-4536-b50d-ec5025360d87" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.184429] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f975e44-e512-4536-b50d-ec5025360d87',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.189847] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.190063] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.190140] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.190279] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.190627] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-b8e9584f-2b3f-4462-8dd7-fa11416409bf taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.191039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.191039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.191408] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.191562] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8e9584f-2b3f-4462-8dd7-fa11416409bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.195052] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.195052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.195052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.195519] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.195842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.195946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.196143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.196250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.196311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.196472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.196575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.196935] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.401116] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 772.419726] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.419726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.419726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.420090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.441233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.442065] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444018] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444018] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.444018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444018] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 772.514208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.514358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.514432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.514647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.514829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.531180] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 772.686626] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f975e44-e512-4536-b50d-ec5025360d87 [ 772.686874] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.687015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.687094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.687322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.687430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.687505] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f975e44-e512-4536-b50d-ec5025360d87 already deleted. [ 772.687818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f975e44-e512-4536-b50d-ec5025360d87" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.694674] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.695103] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.696260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.696260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.696260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.696260] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port b8e9584f-2b3f-4462-8dd7-fa11416409bf not found, creating... [ 772.696260] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.696988] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.697209] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.697504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.698061] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.698503] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.698753] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.698918] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.699216] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.703024] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.703024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: b8e9584f-2b3f-4462-8dd7-fa11416409bf is going to be created. [ 772.703024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.703024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.703024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.730787] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.730787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.730787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.815559] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 772.815559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.205448] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.502270] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8f4adc8-a30f-4a8a-ab6e-f299d6c14c4a req-163a9907-5f03-48b9-a567-9cc09178919c service nova] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_rules [ 773.502651] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8f4adc8-a30f-4a8a-ab6e-f299d6c14c4a req-163a9907-5f03-48b9-a567-9cc09178919c service nova] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 773.502651] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8f4adc8-a30f-4a8a-ab6e-f299d6c14c4a req-163a9907-5f03-48b9-a567-9cc09178919c service nova] Enqueued Resource ID: b8e9584f-2b3f-4462-8dd7-fa11416409bf with Priority: HIGHEST for action port [ 773.505265] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_rules [ 773.505265] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 773.505666] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e9584f-2b3f-4462-8dd7-fa11416409bf with Priority: HIGHEST for action port [ 773.508722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.508722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.508722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.508722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.508722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8e9584f-2b3f-4462-8dd7-fa11416409bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.508722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.508722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.508722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.508722] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8e9584f-2b3f-4462-8dd7-fa11416409bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.519385] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0f76408d-72e1-464b-aa13-f3c05801b737 tempest-ServersTestJSON-1140929688 tempest-ServersTestJSON-1140929688-project-member] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 773.520514] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 773.520514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.521110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.521110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.521110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.521110] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.708143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.708429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.708535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.708835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.708996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.709205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be updated. [ 773.751600] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.751600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.753254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.753483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.753578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.760963] env[65231]: INFO networking_nsxv3.common.synchronization [None req-7b3eb214-d571-43e1-9fe3-6ed0882e2765 tempest-ServersTestJSON-1140929688 tempest-ServersTestJSON-1140929688-project-member] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 773.764132] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 773.765286] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.765502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.770819] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 773.785964] env[65231]: INFO networking_nsxv3.common.synchronization [req-4a4fcbeb-c731-4eb3-a6be-f356f4239405 req-8d500376-1f4c-4dc9-912e-f46317eaec75 tempest-ImagesOneServerTestJSON-1481344964 tempest-ImagesOneServerTestJSON-1481344964-project-member] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 773.786306] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGHEST for action security_group_members [ 773.786840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.786969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.787029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.787261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.788414] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.788565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.788650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.788899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.789861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.789861] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.011482] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8e9584f-2b3f-4462-8dd7-fa11416409bf with status ACTIVE [ 774.011799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.011888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.011950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.012412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.012412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.012565] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.012692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.012746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.012880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.012956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.013159] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.013290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.013396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.013506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.013506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.013590] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8e9584f-2b3f-4462-8dd7-fa11416409bf is going to be updated. [ 774.041278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.041278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.041402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.041556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.041685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.041847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8e9584f-2b3f-4462-8dd7-fa11416409bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.047757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.047906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.048055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.048488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.049690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.050060] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 already deleted. [ 774.050060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.050468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.050752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.051732] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.294840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.294993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.295113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.295436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.295543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.295796] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.295918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.295996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.296200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.296282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.296372] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 is going to be updated. [ 774.326562] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.326692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.326764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.326976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.327133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.338424] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: IN_PROGRESS for 2s [ 774.550506] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 774.550878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.584849] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.585098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.585205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.585584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.585686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.585790] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 already deleted. [ 774.585886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.771061] env[65231]: INFO networking_nsxv3.common.synchronization [None req-00682ae9-7e3c-41c9-9100-7a2c04c4ba0a None None] Enqueued Resource ID: d1d3610a-d125-48b4-9115-9966a5f4067e with Priority: HIGHEST for action port [ 774.771763] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d3610a-d125-48b4-9115-9966a5f4067e with Priority: HIGHEST for action port [ 774.772369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1d3610a-d125-48b4-9115-9966a5f4067e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.772490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1d3610a-d125-48b4-9115-9966a5f4067e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.772613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1d3610a-d125-48b4-9115-9966a5f4067e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.773608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1d3610a-d125-48b4-9115-9966a5f4067e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.773745] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1d3610a-d125-48b4-9115-9966a5f4067e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.278771] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1d3610a-d125-48b4-9115-9966a5f4067e [ 775.279048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.279218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.279297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.279507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.279612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.279709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1d3610a-d125-48b4-9115-9966a5f4067e already deleted. [ 775.279789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1d3610a-d125-48b4-9115-9966a5f4067e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.783962] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 775.784295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.784638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.784638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.784905] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.784905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.784905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.785091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.785134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.785215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.785533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.785632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.785717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.785973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.790318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.790453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.790584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.790856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.790978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.791098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.791285] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.792274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.792494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.792715] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.792846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.792928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.793124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.793604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.793778] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.296153] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86218e2b-505b-489d-9831-63e52af66c10: rpc.has_security_group_logging(os_id): False [ 776.297370] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.315957] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.316144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.316234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.316461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.316554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.316755] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.316881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.316937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.317125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.317205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.317534] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.317635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.317699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.317942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.318834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.318834] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.318834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.319096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.319252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.319331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.319419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be created. [ 776.350995] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 in Status: SUCCESS [ 776.350995] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 deletion is rescheduled due to dependency. [ 776.350995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.386319] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.386450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.386520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.386728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.386903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.399665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 776.521921] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 776.522117] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 776.522807] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 776.523246] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 776.523677] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.524394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.524394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.524394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.524394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.524693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.524693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.524806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.524931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.525083] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.528569] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.528695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.528815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.529018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.529204] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.529299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.529362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.529504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.529584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.529677] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.581414] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 776.581599] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 776.581802] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_rules [ 776.582013] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 776.583542] env[65231]: INFO networking_nsxv3.common.synchronization [req-4935a9e0-07f5-47ce-ab22-3338ec7d89fb req-92f72c7e-bac5-4df0-968f-ff9d0e922522 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 776.584196] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 776.584335] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_rules [ 776.584432] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 776.584521] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 776.584608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 776.585188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.585358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.585392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.585600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.585781] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.587113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.587244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.587315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.587556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.587636] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.588758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-13532539-db1b-4886-aa80-78174f3326ff taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.588872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.589925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.589925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.589925] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13532539-db1b-4886-aa80-78174f3326ff',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.590122] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.590122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.590350] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.590435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.799591] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.033325] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.033325] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.091966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.094478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.094478] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13532539-db1b-4886-aa80-78174f3326ff with status ACTIVE [ 777.094478] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.094478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.094478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.094478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.094478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.094738] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.094738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.094816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.094927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.095082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.095207] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.095300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.095452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.095511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.095559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.095732] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13532539-db1b-4886-aa80-78174f3326ff is going to be updated. [ 777.097778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.097778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.120673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.120829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.120874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.121096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.121277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.121454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.302546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.302697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.302762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.302994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.303108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.303213] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be updated. [ 777.337188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.337333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.337456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.337592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.337797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.352470] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 777.535243] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.537306] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.038017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.038289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.038289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.038542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.038644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.038823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be created. [ 778.040690] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.040690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.040690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.040818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.040958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.041016] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 778.072146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.075020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.075020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.075020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.075020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.078601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.078601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.078601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.078601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.078601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.088449] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: UNINITIALIZED for 2s [ 778.089434] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 778.415802] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 778.416894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.416894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.416894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.416894] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.918847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.920928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.366042] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 779.366042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.366042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.366042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.367540] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.367540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.367540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.367540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.367540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.367540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.367540] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.871043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.871270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.871270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.871492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.871672] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.871994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.871994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.871994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.872193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.872193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.872306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.872443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.872443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.872595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.872714] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.872815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.872887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.873128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.873128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.873313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.873313] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.105115] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 780.105304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.106261] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 780.106479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.106479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.106974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.106974] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.107207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.107207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.107356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.107356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.107479] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.111806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.112127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.112219] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.113327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.113327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.113327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.113327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.113327] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.375445] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86218e2b-505b-489d-9831-63e52af66c10: rpc.has_security_group_logging(os_id): False [ 780.417210] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.417399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.417399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.417625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.417712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.417911] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.418015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.418079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.418221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.418296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.418494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.418586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.418665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.418882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.418963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.420221] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.420340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.421155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.421470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.421621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.421768] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be updated. [ 780.599266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.599458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.599536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.599800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.599988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.614479] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 780.614798] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.615775] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.117709] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.120279] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.377881] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9736720f-09b9-44e3-b26c-0f15d9bad525 None None] Enqueued Resource ID: f79f36a9-daf6-4446-8fa6-927128347b7f with Priority: HIGHEST for action port [ 781.379907] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f79f36a9-daf6-4446-8fa6-927128347b7f with Priority: HIGHEST for action port [ 781.381217] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f79f36a9-daf6-4446-8fa6-927128347b7f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.381472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f79f36a9-daf6-4446-8fa6-927128347b7f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.381558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f79f36a9-daf6-4446-8fa6-927128347b7f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.382107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f79f36a9-daf6-4446-8fa6-927128347b7f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.382107] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f79f36a9-daf6-4446-8fa6-927128347b7f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.621647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.621873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.621873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.623464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.623464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.623464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 781.625034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.625034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.625034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.625034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.625034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.625034] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be updated. [ 781.684543] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.684543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.684543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.684543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.684543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.685907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.686052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.686095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.687322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.687322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.702520] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 781.706288] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 781.884919] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f79f36a9-daf6-4446-8fa6-927128347b7f [ 781.884919] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.884919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.884919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.884919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.884919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.885490] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f79f36a9-daf6-4446-8fa6-927128347b7f already deleted. [ 781.885490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f79f36a9-daf6-4446-8fa6-927128347b7f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.482883] env[65231]: INFO networking_nsxv3.common.synchronization [req-b91485a9-22c9-42bd-a5d8-9a06b2080927 req-012a8ec4-a70f-4f7f-bc35-f5df991c043f tempest-FloatingIPsAssociationTestJSON-1925842782 tempest-FloatingIPsAssociationTestJSON-1925842782-project-member] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 782.483487] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 782.483808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.483933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.483999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.484217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.484374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.484471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.484532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.484677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.484763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.484859] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.626773] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 782.626998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.989095] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.084297] env[65231]: INFO networking_nsxv3.common.synchronization [None req-d0b0ff7d-8a13-415f-b5f4-333a734a5d81 tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 783.086068] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 783.086836] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.087245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.087360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.087795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.088312] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.216814] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9ac16153-52b8-4d63-9820-1753b96871ec tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 783.217612] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 783.218860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.218860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.491738] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.616059] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.616229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.616308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.616535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.616629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.616737] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae already deleted. [ 783.616824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.616980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.617144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.617227] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.732953] env[65231]: INFO networking_nsxv3.common.synchronization [None req-264c50c8-9f1b-45a8-badd-e3c883cab425 None None] Enqueued Resource ID: 6f44ea01-b93a-4058-859e-e6dd4204bc79 with Priority: HIGHEST for action port [ 783.733678] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f44ea01-b93a-4058-859e-e6dd4204bc79 with Priority: HIGHEST for action port [ 783.736009] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 783.736271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.737078] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 783.737983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.738693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f44ea01-b93a-4058-859e-e6dd4204bc79 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.738858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f44ea01-b93a-4058-859e-e6dd4204bc79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.738953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f44ea01-b93a-4058-859e-e6dd4204bc79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.739325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f44ea01-b93a-4058-859e-e6dd4204bc79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.739434] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f44ea01-b93a-4058-859e-e6dd4204bc79',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.741623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.741861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.742415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.744273] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.744273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.745041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.745248] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.745394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.745453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.745617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.745702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.745789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.745878] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.994192] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.994192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.994348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.995448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.995448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.995448] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 784.026718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.026902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.026966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.028028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.028028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.037548] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 784.148107] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.148107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.148107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.148107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.148107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.148107] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae already deleted. [ 784.148107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.248820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f44ea01-b93a-4058-859e-e6dd4204bc79 [ 784.248820] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.248820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.248820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.249165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.249258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.249420] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f44ea01-b93a-4058-859e-e6dd4204bc79 already deleted. [ 784.249524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f44ea01-b93a-4058-859e-e6dd4204bc79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.249817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.249927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.249988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.250175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.250318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.250444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.250537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.250764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.250888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.251024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.251256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.251342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.251409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.251552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.251693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.251785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.251846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.251980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.252067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.252148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.252249] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.253172] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.757804] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 784.758683] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9ba1c5-13c5-4d83-8ace-73ea7d651451: rpc.has_security_group_logging(os_id): False [ 784.777795] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.777912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.777980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.778215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.778301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.778568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.778690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.778777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.778972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.779072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.779166] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be created. [ 784.798691] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.798691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.798691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.798952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.798952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.798952] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.799428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.799428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.799558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.799624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.800431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.800431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.800431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.800431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.800431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.800431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.800431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.800743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.800743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.800743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.800835] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 784.849908] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.849908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.849908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.849908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.849908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.867942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 784.878650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.878989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.878989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.879155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.879255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.898784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 785.134714] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 785.135034] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 785.135080] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 785.135615] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 785.135741] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 785.135871] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 785.136181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfbec76d-ea10-418d-a497-de250f5a975e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.136335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.136441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.136755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.137484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.137705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.137766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.138032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.138142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.138254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.139406] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.139406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.139502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.139618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.139756] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.139913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.139978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.140071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.140243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.140243] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.141586] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.141586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.141586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.141586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.141844] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.141844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.141844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.141957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.141991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.142127] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.186507] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 785.186715] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 785.186851] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_rules [ 785.187033] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 785.187159] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_rules [ 785.187281] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 785.187454] env[65231]: INFO networking_nsxv3.common.synchronization [req-93f4aec2-7543-44f4-af68-05f0b70bfd13 req-fc0d1ed2-e468-434b-9379-8c8b881886b1 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 785.187997] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_rules [ 785.188156] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_rules [ 785.188256] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 785.188359] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13532539-db1b-4886-aa80-78174f3326ff with Priority: HIGHEST for action port [ 785.188522] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_rules [ 785.188522] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 785.188692] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 785.189370] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.189460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.189769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.189875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.190352] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfbec76d-ea10-418d-a497-de250f5a975e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.190450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.190642] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-13532539-db1b-4886-aa80-78174f3326ff taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.190744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.190824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.191060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.191148] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13532539-db1b-4886-aa80-78174f3326ff',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.192063] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfbec76d-ea10-418d-a497-de250f5a975e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.192175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.192253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.192472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.192553] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.193386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.193560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.193722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.194663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.644018] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.645027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.645766] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.695138] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13532539-db1b-4886-aa80-78174f3326ff with status ACTIVE [ 785.696305] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.696869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.696869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.696869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.697206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.697250] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.697367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.697458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.697647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.697753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.697955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.698103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.698139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.698286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.698324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.698404] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13532539-db1b-4886-aa80-78174f3326ff is going to be updated. [ 785.699662] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfbec76d-ea10-418d-a497-de250f5a975e taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.699764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.725145] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.725145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.725145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.725145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.725145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.725145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13532539-db1b-4886-aa80-78174f3326ff" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.060600] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 786.060950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.147589] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.148782] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.149597] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.653402] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.653584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.653659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.653925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.654070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.654226] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be updated. [ 786.655972] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.656105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.656174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.656340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.656442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.656534] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfbec76d-ea10-418d-a497-de250f5a975e is going to be created. [ 786.657687] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.657802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.657869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.658036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.658116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.658211] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 786.688285] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.688438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.688516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.688719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.688870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.692108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.692420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.692499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.692722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.692867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.694136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.694367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.694367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.694498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.694607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.701992] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfbec76d-ea10-418d-a497-de250f5a975e in Status: UNINITIALIZED for 2s [ 786.703082] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 786.704307] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 786.884193] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 786.884324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.884494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.884725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.884815] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.911032] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 786.911208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.911324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.911522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.911646] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.386847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.387163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.414091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.414238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.543241] env[65231]: INFO networking_nsxv3.common.synchronization [req-9f8dd9fc-8382-4c67-91d8-4b1af2e9c31a req-4c41efad-ba55-4642-b958-3a490b224e7c tempest-InstanceActionsTestJSON-505457236 tempest-InstanceActionsTestJSON-505457236-project-member] Enqueued Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 787.543824] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 with Priority: HIGHEST for action security_group_members [ 787.544203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.544354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.544448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.544688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.544852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.545106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.545106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.545210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.545317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.545411] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6430736-9ff5-460b-bc23-c5a9b4bcafe0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.047632] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.047782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.047897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.049301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.049301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.049301] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 is going to be updated. [ 788.087663] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.087873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.087921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.088150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.088308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.104544] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: IN_PROGRESS for 2s [ 788.318012] env[65231]: INFO networking_nsxv3.common.synchronization [req-14b87696-2920-4f44-8742-f4136985ee0b req-26460fda-b011-4986-86ff-26b4f664b7ed tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 788.318188] env[65231]: INFO networking_nsxv3.common.synchronization [req-14b87696-2920-4f44-8742-f4136985ee0b req-26460fda-b011-4986-86ff-26b4f664b7ed tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 788.318302] env[65231]: INFO networking_nsxv3.common.synchronization [req-14b87696-2920-4f44-8742-f4136985ee0b req-26460fda-b011-4986-86ff-26b4f664b7ed tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 788.318855] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGHEST for action security_group_members [ 788.319008] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfbec76d-ea10-418d-a497-de250f5a975e with Priority: HIGHEST for action security_group_members [ 788.319172] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 788.319454] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.319555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.319769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfbec76d-ea10-418d-a497-de250f5a975e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.319853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.320048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.320131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.719481] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 788.719905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.720087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.720407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.720622] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.720768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.720821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.721026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.721111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.721208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.722888] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 788.723100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.723785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfbec76d-ea10-418d-a497-de250f5a975e in Status: SUCCESS [ 788.723963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.724194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.724310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.724478] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.724613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.724663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.724782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.724890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.724945] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.726393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.726653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.726827] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.726956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.727046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.727235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.727365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.727500] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.955046] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-7a71a875-030a-4682-a1c8-2859e60d7ed6 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 788.955610] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 788.958265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.958265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.958265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.958265] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.229981] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.231184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.231332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.231543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.232726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.232726] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.232726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.232726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.232726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.232726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.232726] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be updated. [ 789.233574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.234568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.234671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.234762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.234939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.235074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.235314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.235449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.235527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.235704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.235794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.235901] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfbec76d-ea10-418d-a497-de250f5a975e is going to be deleted. [ 789.264602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.264728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.264799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.265016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.265163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.268789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.268789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.269251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.269251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.269251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.269251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.269251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.269469] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.277068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 789.318040] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-ccef60f9-81ff-4eed-afc9-493878f933e3 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 789.318412] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 789.318970] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.319185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.461462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.461462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.461462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.461462] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 already deleted. [ 789.461879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.461879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.462063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.462260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.462427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.462489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.462633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.462705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.462794] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.641649] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-6baa0c7b-fddb-4394-9a85-a7d5846f7cbb tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 789.642220] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 789.642824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.642824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.738416] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.771899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.772202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.772202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.772494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.772656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.772986] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.773146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.773245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.773470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.773692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.773692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfbec76d-ea10-418d-a497-de250f5a975e already deleted. [ 789.773791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.773839] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.776273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.776371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.776546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.776696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.776775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.776942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.777034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.777134] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.957304] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.957304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.957304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.957304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.957304] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.957842] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.957842] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.958335] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.958625] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.959643] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.959643] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.959643] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.961075] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.961231] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.961429] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.961573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.965698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.965857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.965950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.966187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.966307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.966520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.966644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.966727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.966898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.967008] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.967141] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 already deleted. [ 789.967541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.968153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.968366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.968550] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.968670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.968752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.968915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.969025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.969144] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.980393] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.980705] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.980881] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.981111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.981456] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-8578feea-3d51-4cce-8415-c44f46b9147b taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.981776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.981776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.982486] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.982486] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8578feea-3d51-4cce-8415-c44f46b9147b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.119805] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 in Status: SUCCESS [ 790.119955] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6430736-9ff5-460b-bc23-c5a9b4bcafe0 deletion is rescheduled due to dependency. [ 790.120131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6430736-9ff5-460b-bc23-c5a9b4bcafe0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.241071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.241071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.241209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.241467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.241561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.241665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 790.276313] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfbec76d-ea10-418d-a497-de250f5a975e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.278419] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.278552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.278628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.278867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.279053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.280329] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.280466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.280522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.280728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.280824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.281024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.281146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.281230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.281405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.281496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.281583] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfbec76d-ea10-418d-a497-de250f5a975e already deleted. [ 790.281662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.290597] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 790.474513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.474513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.474834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.475556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.476295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.476720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.477100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.477100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.477791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.478145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.478374] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 already deleted. [ 790.478584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.485153] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.485464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.485639] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.485995] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.486203] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.486510] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 8578feea-3d51-4cce-8415-c44f46b9147b not found, creating... [ 790.486819] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.487028] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.487223] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.487581] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.487807] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.488406] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.488655] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.488783] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.489125] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.489410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.489569] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 8578feea-3d51-4cce-8415-c44f46b9147b is going to be created. [ 790.516429] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.516429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.516807] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.517060] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.517146] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.517404] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.783502] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfbec76d-ea10-418d-a497-de250f5a975e: rpc.has_security_group_logging(os_id): False [ 790.808097] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.808319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.808319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.808532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.808626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.808858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.808959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.809034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.809188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.809265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.809353] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfbec76d-ea10-418d-a497-de250f5a975e is going to be created. [ 790.830320] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e], does not exist path=[/infra/domains/default/groups/cfbec76d-ea10-418d-a497-de250f5a975e]."\n}' [ 790.830320] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfbec76d-ea10-418d-a497-de250f5a975e failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e [ 790.830320] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 790.868905] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.869220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.869370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.869586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.871157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.871157] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.871157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.871157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.871523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.871523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.871875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.871969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.872100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.872525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.872525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.872525] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfbec76d-ea10-418d-a497-de250f5a975e is going to be created. [ 790.900519] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e], does not exist path=[/infra/domains/default/groups/cfbec76d-ea10-418d-a497-de250f5a975e]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e [ 790.901687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfbec76d-ea10-418d-a497-de250f5a975e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.901995] env[65231]: Traceback (most recent call last): [ 790.902068] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 790.902068] env[65231]: return func(*args, **kwargs) [ 790.902068] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 790.902068] env[65231]: res.raise_for_status() [ 790.902068] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 790.902068] env[65231]: raise HTTPError(http_error_msg, response=self) [ 790.902068] env[65231]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e [ 790.902068] env[65231]: During handling of the above exception, another exception occurred: [ 790.902068] env[65231]: Traceback (most recent call last): [ 790.902381] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 790.902381] env[65231]: listener.cb(fileno) [ 790.902381] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 790.902381] env[65231]: result = function(*args, **kwargs) [ 790.902381] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 790.902381] env[65231]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 790.902381] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 790.902381] env[65231]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 790.902381] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 790.902381] env[65231]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 790.902381] env[65231]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 790.902381] env[65231]: res.raise_for_status() [ 790.902381] env[65231]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 790.902381] env[65231]: raise HTTPError(http_error_msg, response=self) [ 790.902381] env[65231]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cfbec76d-ea10-418d-a497-de250f5a975e [ 790.902381] env[65231]: Removing descriptor: 60 [ 791.247890] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-0981acc1-ad9f-410f-80e0-33086c7af313 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 791.248081] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-0981acc1-ad9f-410f-80e0-33086c7af313 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 791.248275] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-0981acc1-ad9f-410f-80e0-33086c7af313 service nova] Enqueued Resource ID: 8578feea-3d51-4cce-8415-c44f46b9147b with Priority: HIGHEST for action port [ 791.248763] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 791.248893] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 791.248985] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8578feea-3d51-4cce-8415-c44f46b9147b with Priority: HIGHEST for action port [ 791.249364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.249533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.249602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.249854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.249952] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.250923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.250923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.251043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.251183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.251356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.251464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.251512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.251649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.251729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.251831] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.254129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8578feea-3d51-4cce-8415-c44f46b9147b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.254129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.254129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.254129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.254379] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8578feea-3d51-4cce-8415-c44f46b9147b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.285869] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 791.286054] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 deletion is rescheduled due to dependency. [ 791.287094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.287094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.287094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.287395] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.287395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.287395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.287697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.287811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.287968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.288042] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.288807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.288978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.289158] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.289272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.289350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.289492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.289560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.289649] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.757225] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.758373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.759458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.759458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8578feea-3d51-4cce-8415-c44f46b9147b with status ACTIVE [ 791.759458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.759458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.759458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.759733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.759733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.759911] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.760029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.760072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.760415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.760523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.760675] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.760769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.760937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.761146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.761146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.761146] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8578feea-3d51-4cce-8415-c44f46b9147b is going to be updated. [ 791.787025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.788167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.788167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.788167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.788167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.788167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8578feea-3d51-4cce-8415-c44f46b9147b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.793466] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.793606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.794275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.794275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.794898] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.818590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.818815] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.818925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.818925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.819162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.819287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.819394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be updated. [ 791.847320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.847320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.847497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.847957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.847957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.859730] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 792.097039] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.097039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-490" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.097039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-490" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.097304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-490" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.097761] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.097761] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.097761] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.098036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.098504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.098504] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.098504] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.098686] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.098730] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.098992] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.098992] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.099120] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.121996] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.122446] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.123240] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.123520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-490" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.123823] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-de103dca-bf12-4d27-b99d-7a93bd6c09b1 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.124017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.124137] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.124532] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.124728] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de103dca-bf12-4d27-b99d-7a93bd6c09b1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.264267] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.297965] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9ba1c5-13c5-4d83-8ace-73ea7d651451: rpc.has_security_group_logging(os_id): False [ 792.302749] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 792.306267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.306469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.306666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.309889] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.309889] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.309889] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.309889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.309889] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.320499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.320499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.320499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.320499] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be updated. [ 792.380255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.380424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.380493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.380729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.381558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.395755] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: IN_PROGRESS for 2s [ 792.629327] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.629565] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.629691] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.629980] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.630141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.630296] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port de103dca-bf12-4d27-b99d-7a93bd6c09b1 not found, creating... [ 792.630619] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.630740] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.630969] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.631348] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.631457] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.631730] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.631882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.631993] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.632210] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.632345] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.632544] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: de103dca-bf12-4d27-b99d-7a93bd6c09b1 is going to be created. [ 792.655454] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.655828] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.655961] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.656141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.656369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.656592] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.766798] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.767094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.767190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.767408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.767504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.767657] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be created. [ 792.798512] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.798794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.798794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.798946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.799120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.812564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.812702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.812895] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.814783] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: UNINITIALIZED for 2s [ 793.315548] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-5024402f-a017-468d-bb80-c20e47c031c2 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-5024402f-a017-468d-bb80-c20e47c031c2 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-5024402f-a017-468d-bb80-c20e47c031c2 service nova] Enqueued Resource ID: de103dca-bf12-4d27-b99d-7a93bd6c09b1 with Priority: HIGHEST for action port [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 793.406228] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de103dca-bf12-4d27-b99d-7a93bd6c09b1 with Priority: HIGHEST for action port [ 793.408103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.408385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.408744] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.408959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.409800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-de103dca-bf12-4d27-b99d-7a93bd6c09b1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.409800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.409800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.409800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.409800] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de103dca-bf12-4d27-b99d-7a93bd6c09b1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.818429] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.819526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.819526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.819936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.820206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.820416] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 793.855807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.856125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.856125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.856301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.856463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.869222] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 793.869952] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 deletion is rescheduled due to dependency. [ 793.869952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.870365] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 793.912900] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de103dca-bf12-4d27-b99d-7a93bd6c09b1 with status ACTIVE [ 793.913202] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.913377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.913377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.913598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.913808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.913931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.914053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.914118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.914283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.914380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.914567] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.914686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.914742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.914899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.914971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.915085] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de103dca-bf12-4d27-b99d-7a93bd6c09b1 is going to be updated. [ 793.949761] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.950106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.950198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.950457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.950671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.950889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de103dca-bf12-4d27-b99d-7a93bd6c09b1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.278395] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.278803] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.278803] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.278959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.279922] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.279922] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.279922] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.280215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.280215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.280407] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.280520] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.280626] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.280775] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.280890] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.280995] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.281142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.300697] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.300904] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.301017] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.301201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-378" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.301609] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-8fd38f92-0d2f-4dc3-9330-1283f9585c96 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.301806] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.301927] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.302315] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.302425] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fd38f92-0d2f-4dc3-9330-1283f9585c96',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.409429] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 in Status: SUCCESS [ 794.410822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.515297] env[65231]: INFO networking_nsxv3.common.synchronization [None req-856cc653-a029-4888-8d19-5bd3978f4379 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 794.515935] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 794.516269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.516414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.516502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.516712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.516796] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.634491] env[65231]: INFO networking_nsxv3.common.synchronization [None req-6e467290-4838-4c0e-9f01-c463887d99b7 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 794.634949] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 794.635342] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.635582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.805586] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.805586] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.805586] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.806086] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.806086] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.806201] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 8fd38f92-0d2f-4dc3-9330-1283f9585c96 not found, creating... [ 794.806460] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.806654] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.806762] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.807012] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.807149] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.807452] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.807618] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.807732] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.807943] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.808207] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.808359] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 8fd38f92-0d2f-4dc3-9330-1283f9585c96 is going to be created. [ 794.828254] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 794.828254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.828254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.828254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.828254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.828254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.829031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.829031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.829031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.829031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.829031] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.829950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.830144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.830322] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.830432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.830495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.830635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.830705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.830801] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.834361] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.834777] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.834777] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.834893] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.835297] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.835561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.053875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.054250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.054250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.054382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.054450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054506] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d already deleted. [ 795.054600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.055131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.055131] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.333409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.333409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.333574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-035bfa3f-33d0-4806-a011-a09f87c65100 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-035bfa3f-33d0-4806-a011-a09f87c65100 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [req-e6f70b2f-fcac-494d-a6b7-52cf67fd8b2b req-035bfa3f-33d0-4806-a011-a09f87c65100 service nova] Enqueued Resource ID: 8fd38f92-0d2f-4dc3-9330-1283f9585c96 with Priority: HIGHEST for action port [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 795.539506] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fd38f92-0d2f-4dc3-9330-1283f9585c96 with Priority: HIGHEST for action port [ 795.539882] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.540162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.540555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.541276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.541276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fd38f92-0d2f-4dc3-9330-1283f9585c96 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.541276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.541276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.541568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.541669] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fd38f92-0d2f-4dc3-9330-1283f9585c96',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.575949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.576118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.576171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.576382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.576470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.576565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d already deleted. [ 795.576672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.837224] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.880359] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 795.881030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.881030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.881030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.881365] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.881508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.881508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.881636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.881695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.881784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.881955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.882063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.882126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.882269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.882411] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.882534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.882591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.882882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.882882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.882882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.883033] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.046710] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fd38f92-0d2f-4dc3-9330-1283f9585c96 with status ACTIVE [ 796.046710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.046710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.046710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.046710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.046710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.047269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.047378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047444] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.048236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.048418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.048519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.048770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.048911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.049118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fd38f92-0d2f-4dc3-9330-1283f9585c96 is going to be updated. [ 796.072683] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.072852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.072928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.073187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.073426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.073518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fd38f92-0d2f-4dc3-9330-1283f9585c96" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.340631] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.340823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.340871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.341141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.341216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.341363] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 796.379076] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.379246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.379308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.379549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.379712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.385565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01685928-70c6-4a4e-8584-3fbdbe9910e3: rpc.has_security_group_logging(os_id): False [ 796.401528] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 796.405676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.405843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.405934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.406128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.426762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.427075] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.427213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.427275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.427483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.427585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.427800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.427919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.427978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.428141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.428255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.428459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.428627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.428627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.428782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.428885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.428963] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 796.513560] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.513703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.513785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.514104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.514209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.527952] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 796.725570] env[65231]: INFO networking_nsxv3.common.synchronization [req-533b0dd0-a1f7-4b66-b005-dd11460272a6 req-50fc7c89-82bf-4053-972a-ed0b987602db tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 796.726703] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 796.727339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.727501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.727585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.727813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.728065] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.728196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.728266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.728455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.728539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.728689] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.085325] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.085977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.086774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.087229] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.087668] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.088046] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.088156] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.088490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.088741] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.089047] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.089245] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.089413] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.089650] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.089867] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.090010] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.090230] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.123136] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.123410] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.123475] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.123993] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-380" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.124320] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-67ff8e11-d8a3-4379-bc9b-07dfb1960994 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.124791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.124791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.125130] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.125561] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ff8e11-d8a3-4379-bc9b-07dfb1960994',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.234157] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.627747] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.628118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.628288] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.628675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.628886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.629084] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 67ff8e11-d8a3-4379-bc9b-07dfb1960994 not found, creating... [ 797.629489] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.629685] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.629839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.630181] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.630354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.630738] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.630943] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.631177] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.631504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.631663] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.631852] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 67ff8e11-d8a3-4379-bc9b-07dfb1960994 is going to be created. [ 797.655815] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.655815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.655815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.655815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.656299] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.656299] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.738028] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.239705] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.239984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.240035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.240477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.240477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.240477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 798.270176] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.270363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.270460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.270713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.270891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.284023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 798.389484] env[65231]: INFO networking_nsxv3.common.synchronization [req-533b0dd0-a1f7-4b66-b005-dd11460272a6 req-b7f98864-5401-49aa-9031-750a4a8eeb33 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 798.390297] env[65231]: INFO networking_nsxv3.common.synchronization [req-533b0dd0-a1f7-4b66-b005-dd11460272a6 req-b7f98864-5401-49aa-9031-750a4a8eeb33 service nova] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 798.390297] env[65231]: INFO networking_nsxv3.common.synchronization [req-533b0dd0-a1f7-4b66-b005-dd11460272a6 req-b7f98864-5401-49aa-9031-750a4a8eeb33 service nova] Enqueued Resource ID: 67ff8e11-d8a3-4379-bc9b-07dfb1960994 with Priority: HIGHEST for action port [ 798.390593] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_rules [ 798.390593] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 798.390593] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ff8e11-d8a3-4379-bc9b-07dfb1960994 with Priority: HIGHEST for action port [ 798.390803] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.391754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.391754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.391754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.391754] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.392897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.393083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.393275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ff8e11-d8a3-4379-bc9b-07dfb1960994 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.393371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.393467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.393609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.393688] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ff8e11-d8a3-4379-bc9b-07dfb1960994',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.412954] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 798.413188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.413994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.414229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.414420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.414856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.414856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.414856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.414856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.415056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.415056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.415147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.415188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.415305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.415437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.415530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.415590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.415720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.415792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.415886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.415972] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.416954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.417131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.417298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.417399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.417466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.418068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.418068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.418068] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.548637] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 798.548891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.898253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898253] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67ff8e11-d8a3-4379-bc9b-07dfb1960994 with status ACTIVE [ 798.898253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.898253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.898253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.898253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.898760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.898760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.898760] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67ff8e11-d8a3-4379-bc9b-07dfb1960994 is going to be updated. [ 798.918998] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4930f591-dad9-4803-8936-7b21d9dabe55: rpc.has_security_group_logging(os_id): False [ 798.920296] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.922572] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.922742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.922803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.922961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.923111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.923272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ff8e11-d8a3-4379-bc9b-07dfb1960994" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.943766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.943766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.943766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.943766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.943766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.943766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.943766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.944501] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.944501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.944741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.944741] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.944818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.944853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.944994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.945176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.945268] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be created. [ 799.047378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.047378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.047538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.047890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.047936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.068452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 799.424964] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.927966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.928518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.928518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.928518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.928518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.928518] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 799.961793] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.961980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.962062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.962280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.962472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.973846] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 800.297944] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 800.298246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.298496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.298734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.298949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.299074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.299148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.299399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.299399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.299564] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.802033] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.086241] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 801.086486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.086663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.086899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.086995] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.304438] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.591170] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.591170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.808810] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.809082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.809082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.809289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.809376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.809480] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 801.813043] env[65231]: INFO networking_nsxv3.common.synchronization [req-04a04618-1c2a-4023-832b-9764803f6ca8 req-c8a9a84d-62f8-46f4-897b-84ebce8042fa tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 801.814187] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 801.814589] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.814892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.814964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.815227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.815427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.815589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.815693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.816086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.816086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.816221] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.847674] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.847876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.847876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.848105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.848251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.858536] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 801.985784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 801.985915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.986698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.986698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.986698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.986945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.986945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.988871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.988871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.988871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.988871] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.216029] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.216029] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.216029] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.216029] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.216029] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.216885] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.217875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.217875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.217875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.218539] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.219759] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.219759] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.219998] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.222022] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.222022] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.222022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.244636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.245870] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.245870] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.246753] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.248027] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-4e776970-46be-414f-9a91-ad1ee0dfcef9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.248027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.248027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.248698] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.249126] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e776970-46be-414f-9a91-ad1ee0dfcef9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.320209] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.491699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.491699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.491699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.492300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.492300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.492300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.492300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.492300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.492300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.492651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.492651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.492651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.492743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.492743] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.619881] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0a68042f-1c02-4d36-bbb8-bd086e484307 None None] Enqueued Resource ID: 5330c30f-8b5f-4000-ae4a-c98b0ef951e5 with Priority: HIGHEST for action port [ 802.620431] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5330c30f-8b5f-4000-ae4a-c98b0ef951e5 with Priority: HIGHEST for action port [ 802.620749] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5330c30f-8b5f-4000-ae4a-c98b0ef951e5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.620871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5330c30f-8b5f-4000-ae4a-c98b0ef951e5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.620964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5330c30f-8b5f-4000-ae4a-c98b0ef951e5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.622489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5330c30f-8b5f-4000-ae4a-c98b0ef951e5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.622724] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5330c30f-8b5f-4000-ae4a-c98b0ef951e5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.752138] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.752392] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.753030] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.753030] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.753030] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.753183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 4e776970-46be-414f-9a91-ad1ee0dfcef9 not found, creating... [ 802.754152] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.754152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.754152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.754152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.754152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.754632] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.754632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.754632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.754839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.755508] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.755738] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 4e776970-46be-414f-9a91-ad1ee0dfcef9 is going to be created. [ 802.777231] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.777498] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.777652] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.777968] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.778252] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.778514] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.821609] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.994408] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4930f591-dad9-4803-8936-7b21d9dabe55: rpc.has_security_group_logging(os_id): False [ 803.015787] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.015991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.015991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.016219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.016308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.016515] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.016612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.016674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.016823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.016898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.017325] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.017325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.017325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.017509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.017509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.017624] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.017738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.017822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.017968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.019152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.019292] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 803.085396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.085781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.085781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.086072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.086836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.103920] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 803.128397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5330c30f-8b5f-4000-ae4a-c98b0ef951e5 [ 803.128397] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.128397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.128397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.128397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.128397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.128397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5330c30f-8b5f-4000-ae4a-c98b0ef951e5 already deleted. [ 803.128397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5330c30f-8b5f-4000-ae4a-c98b0ef951e5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.325438] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.325665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.325715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.325981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.326102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.326175] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 803.366140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.366391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.366391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.366586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.366728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.379138] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 803.543583] env[65231]: INFO networking_nsxv3.common.synchronization [req-04a04618-1c2a-4023-832b-9764803f6ca8 req-2f3c5823-62d9-4f57-9751-67740fc3b00f service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 803.543764] env[65231]: INFO networking_nsxv3.common.synchronization [req-04a04618-1c2a-4023-832b-9764803f6ca8 req-2f3c5823-62d9-4f57-9751-67740fc3b00f service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 803.543898] env[65231]: INFO networking_nsxv3.common.synchronization [req-04a04618-1c2a-4023-832b-9764803f6ca8 req-2f3c5823-62d9-4f57-9751-67740fc3b00f service nova] Enqueued Resource ID: 4e776970-46be-414f-9a91-ad1ee0dfcef9 with Priority: HIGHEST for action port [ 803.544496] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 803.544705] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 803.544879] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e776970-46be-414f-9a91-ad1ee0dfcef9 with Priority: HIGHEST for action port [ 803.545408] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.545556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.545670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.545936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.546147] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.548496] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.548496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.548496] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e776970-46be-414f-9a91-ad1ee0dfcef9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.548496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.548812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.550790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.550790] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e776970-46be-414f-9a91-ad1ee0dfcef9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.868604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 803.868954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.869013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.869219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.869424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.869539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.869604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.869761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.869866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.869954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.870072] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.051850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.051850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.051850] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e776970-46be-414f-9a91-ad1ee0dfcef9 with status ACTIVE [ 804.051850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.051850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.051850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.051850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.052291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.052291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.052379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.052412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.052616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.052721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.052932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.053132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.053201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.053348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.053421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.053511] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e776970-46be-414f-9a91-ad1ee0dfcef9 is going to be updated. [ 804.078274] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.078274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.078274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.078557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.078782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.078951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e776970-46be-414f-9a91-ad1ee0dfcef9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.373471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.373634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.373706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.373951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.374096] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.374256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.374256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.374410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.374492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.374593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.374774] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.374844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.374844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.374985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.375130] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.375221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.375281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.375414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.375489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.375571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.375659] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.883930] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93d71ddd-aafd-4027-b22a-d8863fc345e7: rpc.has_security_group_logging(os_id): False [ 804.902762] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.902762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.902972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.904743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.924810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.925254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.925387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.925457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.925671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.925753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.926109] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.926257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.926325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.926484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.926561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.927180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.927320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.927412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.927588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.927687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.927873] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 804.991992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.992167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.992211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.992620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.992620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.006560] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 805.127925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 805.128193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.128398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.130939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.131069] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.253909] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f832520e-3ee9-4019-84d6-4df69bb0e0d1 None None] Enqueued Resource ID: 9917410b-8e98-4dba-b842-c610f7e0283b with Priority: HIGHEST for action port [ 805.254521] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9917410b-8e98-4dba-b842-c610f7e0283b with Priority: HIGHEST for action port [ 805.254897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9917410b-8e98-4dba-b842-c610f7e0283b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.255056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9917410b-8e98-4dba-b842-c610f7e0283b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.255126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9917410b-8e98-4dba-b842-c610f7e0283b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.255415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9917410b-8e98-4dba-b842-c610f7e0283b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.255567] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9917410b-8e98-4dba-b842-c610f7e0283b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.394603] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 805.395643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.395786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.396036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.396239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.396368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.396454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.396946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.397123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.397233] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.633921] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.636521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.636521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.636521] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.758039] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9917410b-8e98-4dba-b842-c610f7e0283b [ 805.758351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.758553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.759937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.759937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.759937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.759937] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9917410b-8e98-4dba-b842-c610f7e0283b already deleted. [ 805.759937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9917410b-8e98-4dba-b842-c610f7e0283b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.901348] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.138761] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.138963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.139066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.139214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.139695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.139695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.139695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.140438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.140629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.140740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.140906] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.141163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.141163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.141288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.141355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.141511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.141588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.141711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.141792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.141910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.141979] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.404731] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.646210] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4930f591-dad9-4803-8936-7b21d9dabe55: rpc.has_security_group_logging(os_id): False [ 806.672778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.672778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.672778] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.672778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.673620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.673620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.673620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.673620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.673620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.673620] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 806.750514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.750514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.750514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.750514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.750514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.768730] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 806.907281] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.907540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.908248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.908486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.908604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.908712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 806.951251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.954239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.954365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.954537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.954696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.966925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 807.020306] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 807.020529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.788614] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 808.788910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.979655] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 808.979907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.980065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.980387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.980545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.980708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.980766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.980927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.980988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.981134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.981206] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.483650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.483887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.483887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.484138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.484320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.484409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.484465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.484611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.484709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.484820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.484979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.485129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.485129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.485290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.485657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.485657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.485927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.486116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.486495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.486495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.486495] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.988901] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 810.013499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.013499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.013499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.013831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.046377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.046377] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.046586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.046586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.046773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.046853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.047059] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.047156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.047214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.047414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.047450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.047624] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.047705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.047759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.047904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.047972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.048069] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 810.127438] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.127690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.127847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.128184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.128460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.148641] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 810.236219] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fb62805-f948-46dd-b1b3-42305e52a66f req-a5e4b4c4-9686-432d-ac0d-1993bbbce0e0 tempest-TenantUsagesTestJSON-1505704655 tempest-TenantUsagesTestJSON-1505704655-project-member] Enqueued Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 810.237047] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 810.237218] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.237349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.238136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.238136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.238136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.238136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.238136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.238376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.238376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.238376] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.639322] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-391 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.640246] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.641103] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.641103] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.641103] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.645143] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.645143] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.645143] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.645143] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.645143] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.645143] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.645143] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.645143] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.645143] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.645143] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.645143] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.668639] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.668777] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.668934] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.669513] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-391" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.669781] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-5996201e-5cec-4c9c-8067-b59ee10737a2 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.669955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.670089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.670436] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.671030] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5996201e-5cec-4c9c-8067-b59ee10737a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.741236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.741428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.741548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.741761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.741853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.742064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.742165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.742262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.742368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.742457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.742544] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a already deleted. [ 810.742628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.895477] env[65231]: INFO networking_nsxv3.common.synchronization [req-ec7cb062-b4fe-48eb-a443-556c2e22265c req-fd55dc12-8131-43db-8930-2e396b348de5 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 810.895830] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 810.896168] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.896290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.896370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.896570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.896719] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.896818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.896879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.897036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.897122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.897216] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.173666] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.174215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.174215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.174353] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.174531] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.174693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 5996201e-5cec-4c9c-8067-b59ee10737a2 not found, creating... [ 811.174987] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.175174] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.175293] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.175551] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.175724] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.176043] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.176205] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.176340] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.176571] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.176710] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.176875] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 5996201e-5cec-4c9c-8067-b59ee10737a2 is going to be created. [ 811.198476] env[65231]: INFO networking_nsxv3.common.synchronization [req-ec7cb062-b4fe-48eb-a443-556c2e22265c req-78280819-9117-40d5-8bc6-87a4b02f6f54 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 811.198927] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 811.199254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.199355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.200449] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.200624] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.200742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.201015] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.201249] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.201489] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.400184] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.611944] env[65231]: INFO networking_nsxv3.common.synchronization [req-ec7cb062-b4fe-48eb-a443-556c2e22265c req-70dbbd73-8a2a-4a27-991f-5e174a8bfb11 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 811.612645] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 811.613216] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.613412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.902633] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.009431] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fb62805-f948-46dd-b1b3-42305e52a66f req-cf2eca88-0b37-4525-9891-3659309143d2 service nova] Enqueued Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_rules [ 812.009692] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fb62805-f948-46dd-b1b3-42305e52a66f req-cf2eca88-0b37-4525-9891-3659309143d2 service nova] Enqueued Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 812.009882] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fb62805-f948-46dd-b1b3-42305e52a66f req-cf2eca88-0b37-4525-9891-3659309143d2 service nova] Enqueued Resource ID: 5996201e-5cec-4c9c-8067-b59ee10737a2 with Priority: HIGHEST for action port [ 812.014693] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_rules [ 812.014852] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 812.014949] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5996201e-5cec-4c9c-8067-b59ee10737a2 with Priority: HIGHEST for action port [ 812.015301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.015508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.015508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.015757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.015851] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.017028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.017028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.017028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.018789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.018789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.018928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.018928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.019272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.019272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.019272] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.025807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5996201e-5cec-4c9c-8067-b59ee10737a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.025807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.025807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.025807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.025807] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5996201e-5cec-4c9c-8067-b59ee10737a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.163639] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 812.163639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.405144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.405481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.405773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.406740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.406740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.406740] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 812.441700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.441867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.441962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.442321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.442321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.451537] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 812.525593] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.528841] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.529706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.529706] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5996201e-5cec-4c9c-8067-b59ee10737a2 with status ACTIVE [ 812.529706] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.529706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.529706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.530256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.530256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.530431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.530431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.530530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.531488] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.531488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.531817] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5996201e-5cec-4c9c-8067-b59ee10737a2 is going to be updated. [ 812.554390] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.554390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.554390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.554390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.554611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.555021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5996201e-5cec-4c9c-8067-b59ee10737a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.651023] env[65231]: INFO networking_nsxv3.common.synchronization [req-0457b762-210b-412a-9247-6a70ee62ed6b req-5b5c0b38-3556-4765-a469-73c4bc4c1579 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 812.651023] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 812.651023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.651023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.651023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.651023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.652570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.652731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.652773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.652965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.653064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.653164] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.028501] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.028727] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.028886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.029273] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.029561] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.029756] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.029892] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.030168] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.030357] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.030610] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.030754] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.030879] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.031028] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.031158] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.031279] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.031481] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.033363] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.052095] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.052352] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.052571] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.052791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.053178] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-bcf94c75-4720-475c-9a9f-ea253b6cbc45 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.053387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.053551] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.053934] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.054104] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf94c75-4720-475c-9a9f-ea253b6cbc45',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.156332] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.156475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.156475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.156685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.179185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.179465] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.179608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.179723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.179860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.179968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.180059] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 813.213647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.213647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.213647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.213647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.214056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.226221] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 813.535918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.536361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.536361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.536476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.536516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.536894] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a is going to be created. [ 813.556556] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.556824] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.556905] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.557269] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.557478] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.557596] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port bcf94c75-4720-475c-9a9f-ea253b6cbc45 not found, creating... [ 813.557857] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.558026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.558146] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.558362] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.558545] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.558865] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.559082] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.559225] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.559464] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.559559] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.559699] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: bcf94c75-4720-475c-9a9f-ea253b6cbc45 is going to be created. [ 813.561871] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.561995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.562059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.562209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.562355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.574306] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: UNINITIALIZED for 2s [ 813.587315] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.587629] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.587921] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.588224] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.588502] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.588802] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [req-0457b762-210b-412a-9247-6a70ee62ed6b req-24d6ea1c-51c8-4856-8ae9-bbed2efefedb service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [req-0457b762-210b-412a-9247-6a70ee62ed6b req-24d6ea1c-51c8-4856-8ae9-bbed2efefedb service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [req-0457b762-210b-412a-9247-6a70ee62ed6b req-24d6ea1c-51c8-4856-8ae9-bbed2efefedb service nova] Enqueued Resource ID: bcf94c75-4720-475c-9a9f-ea253b6cbc45 with Priority: HIGHEST for action port [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 814.330154] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf94c75-4720-475c-9a9f-ea253b6cbc45 with Priority: HIGHEST for action port [ 814.330154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.330154] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.330154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.330154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf94c75-4720-475c-9a9f-ea253b6cbc45 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.330154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.330154] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf94c75-4720-475c-9a9f-ea253b6cbc45',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.462290] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 814.462532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.462685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.462921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.463128] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.463320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.463320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.463465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.464086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.464086] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.831590] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcf94c75-4720-475c-9a9f-ea253b6cbc45 with status ACTIVE [ 814.831879] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.832308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.832403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.832618] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.832992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.833086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.833379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.833441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.833583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.833659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833803] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcf94c75-4720-475c-9a9f-ea253b6cbc45 is going to be updated. [ 814.835677] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.835821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.856878] env[65231]: INFO networking_nsxv3.common.synchronization [None req-ce0fd5d9-30cd-4758-bef6-8bef9c396561 None None] Enqueued Resource ID: 8927a79c-24c5-42e4-b44e-adb25e14cd27 with Priority: HIGHEST for action port [ 814.858275] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8927a79c-24c5-42e4-b44e-adb25e14cd27 with Priority: HIGHEST for action port [ 814.859581] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.859913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.859992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.860266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.860661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.860661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf94c75-4720-475c-9a9f-ea253b6cbc45" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.860870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8927a79c-24c5-42e4-b44e-adb25e14cd27 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.860967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8927a79c-24c5-42e4-b44e-adb25e14cd27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.861089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8927a79c-24c5-42e4-b44e-adb25e14cd27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.861276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8927a79c-24c5-42e4-b44e-adb25e14cd27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.861361] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8927a79c-24c5-42e4-b44e-adb25e14cd27',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.966637] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.966826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.966896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.967125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.967238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.967412] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.967515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.967599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.968416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.968416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.968416] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 815.001410] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.001410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.001410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.001410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.001410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.010871] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 815.238978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 815.238978] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 815.238978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.238978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.239351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.239650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.239858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.242398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.244756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.244756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.244756] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.364020] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8927a79c-24c5-42e4-b44e-adb25e14cd27 [ 815.364377] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.364552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.364645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.364855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.364956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.365057] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8927a79c-24c5-42e4-b44e-adb25e14cd27 already deleted. [ 815.365150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8927a79c-24c5-42e4-b44e-adb25e14cd27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.585172] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: SUCCESS [ 815.586044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.586481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.586688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.586977] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.587165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.587299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.587542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.587663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.587830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.587965] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.748775] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.091653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.091653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.091653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.092140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.092140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.092140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.092304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.092343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.092411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.092502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.092657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.092745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.092809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.092965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.093107] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.093203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.093286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.093399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.093477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.093561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.093657] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.250355] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.599344] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb52a7d4-b318-4846-9f1c-63a06c5cba5a: rpc.has_security_group_logging(os_id): False [ 816.630535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630535] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.630535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.635339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.635339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.635339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.635339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.635339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.635339] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a is going to be created. [ 816.722309] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.722526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.722526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.723214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.723214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.752725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: IN_PROGRESS for 2s [ 816.753259] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.753368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.753410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.753590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.753677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.753785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 816.813148] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.813323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.813399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.813602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.813755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.849027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 817.023821] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 817.024050] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 deletion is rescheduled due to dependency. [ 817.024195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.024412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.024673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.027892] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.028132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.028789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.028789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.028789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.028789] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.532225] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.532225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.532743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.532743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.532743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.532868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.532978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.533079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.533225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.533302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.533418] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 817.565212] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.565349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.565431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.566472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.566472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.576542] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 817.592648] env[65231]: INFO networking_nsxv3.common.synchronization [req-09367fe1-fcc5-4a81-9c28-c6f88c74071b req-ceafec15-1e12-4659-9e05-9cf8c394f549 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 817.593270] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 817.593587] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.593913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.593913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.594080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.594260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.594337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.594384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.594535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.594621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.595157] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.968725] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.968924] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.969060] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.969328] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.971405] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.971643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.971778] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.972475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.973088] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.973088] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.973088] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.973240] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.973282] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.973368] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.973467] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.973597] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.994650] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.994825] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.994960] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.995152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.995464] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.995636] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.995754] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.996094] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.996231] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9bdf2f5-4ce7-45a6-a54f-9842821e2a51',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.080576] env[65231]: INFO networking_nsxv3.common.synchronization [req-789dd740-aeaf-4039-9bd3-0a45d013ed3f req-8721ff04-6b6f-4e03-a3c4-35df5b9cfb0f tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 818.081674] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 818.081876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.082093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.082207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.082518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.082871] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.082984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.083066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.083236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.083307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.083399] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.097753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.098164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.098164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.098282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.098282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.098456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.098550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.098611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.098752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.098824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.098905] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 already deleted. [ 818.098984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.499868] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.500258] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.500531] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.500730] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.500882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.501047] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 not found, creating... [ 818.501311] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.501496] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.501609] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.501858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.501960] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.502270] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.502424] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.502539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.502746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.502877] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.503265] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 is going to be created. [ 818.529052] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.529052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.529052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.529316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.529371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.529604] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.585993] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2f9f060d-fd27-4514-8e37-a19241822607 None None] Enqueued Resource ID: 10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf with Priority: HIGHEST for action port [ 818.586525] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.587387] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf with Priority: HIGHEST for action port [ 818.587999] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.588168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.588253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.588516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.588602] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.766463] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: SUCCESS [ 818.766851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.857355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 818.857503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.857687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.858533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.858533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.858973] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.088274] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.090183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf [ 819.090539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.090804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.090967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.091266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.091453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.091717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf already deleted. [ 819.091897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10369a3f-b59b-4d55-9f9f-5d7f37e3b7bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.313698] env[65231]: INFO networking_nsxv3.common.synchronization [req-09367fe1-fcc5-4a81-9c28-c6f88c74071b req-125e986e-cf32-4419-83f0-51140aadb93b service nova] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_rules [ 819.314382] env[65231]: INFO networking_nsxv3.common.synchronization [req-09367fe1-fcc5-4a81-9c28-c6f88c74071b req-125e986e-cf32-4419-83f0-51140aadb93b service nova] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 819.314750] env[65231]: INFO networking_nsxv3.common.synchronization [req-09367fe1-fcc5-4a81-9c28-c6f88c74071b req-125e986e-cf32-4419-83f0-51140aadb93b service nova] Enqueued Resource ID: e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 with Priority: HIGHEST for action port [ 819.316467] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_rules [ 819.316467] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 819.316467] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 with Priority: HIGHEST for action port [ 819.316467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.316467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.316467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.316947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.317095] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.319140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.319628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.319800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.320061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.320276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.320799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.321140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.321421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.321669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.321877] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.324246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.324483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.324607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.324835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.325029] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9bdf2f5-4ce7-45a6-a54f-9842821e2a51',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.360960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.361147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.361289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.362145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.362145] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.362301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.362301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.362489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.362614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.362707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.363167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.363167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.363167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.363167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.363357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.363461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.363461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.363602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.363672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.364834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.364834] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.588236] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 819.588536] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 deletion is rescheduled due to dependency. [ 819.588583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.593237] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.593375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.593445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.593655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.593742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.593841] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 819.629315] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.629315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.629577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.629643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.630256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.642234] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 819.820301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.820301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.824861] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.828230] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 with status ACTIVE [ 819.828230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.828230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.828691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.828691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.828691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.829176] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.829176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.829176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.829432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.829520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.829723] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.829935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.830064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.830290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.830399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.830530] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9bdf2f5-4ce7-45a6-a54f-9842821e2a51 is going to be updated. [ 819.866409] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 819.868270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.868427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.868506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.868682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.868833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.869046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9bdf2f5-4ce7-45a6-a54f-9842821e2a51" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.903842] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.903988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.904085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.904298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.904411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.904623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.904738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.904800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.904950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.905132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.905241] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.905346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.905400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.905545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.905689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.905797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.905886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.905955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.906111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.906182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.906272] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 820.041554] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.041756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.041824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.042045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.042198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.056954] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 820.327459] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.829819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.830205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.830205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.830315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.830368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.830471] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be created. [ 820.858380] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.858615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.858615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.858836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.859013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.868641] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: UNINITIALIZED for 2s [ 821.421635] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5c1580-3bd1-4d20-9bf1-0cc7e6186877 req-b942b5e9-5d22-4f4c-9322-d2a37d2eff8f tempest-ServersTestJSON-1140929688 tempest-ServersTestJSON-1140929688-project-member] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 821.423120] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 821.423467] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.423713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.423713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.424025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.424233] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.424366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.425051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.425051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.425051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.425051] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.654229] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 821.654497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.824721] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.825065] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.825288] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.825742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.826081] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.826332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.826506] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.826752] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.826900] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.827171] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.827312] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.827449] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.827539] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.827670] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.827807] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.827953] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.846725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.847028] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.847028] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.847236] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-689" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.847616] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-994cb153-0016-4afc-84d1-2f01ee11a6aa taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.847806] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.847853] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.848236] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.848435] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('994cb153-0016-4afc-84d1-2f01ee11a6aa',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.927713] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.927713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.927713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.928035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.928035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.928277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.928383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.928447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.928600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.928679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.928790] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 already deleted. [ 821.928876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.074489] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 822.074728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350972] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.351231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.351375] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.351711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.351859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.352038] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 994cb153-0016-4afc-84d1-2f01ee11a6aa not found, creating... [ 822.352348] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.352547] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.352662] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.352890] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.353046] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.353331] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.353513] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.353638] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.353787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.353935] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.354144] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 994cb153-0016-4afc-84d1-2f01ee11a6aa is going to be created. [ 822.374755] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.374755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.374755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.375091] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.375805] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.375805] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.882864] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 822.883210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.884064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.884348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.884591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.884741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.884827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.885035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.885153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.885269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.885379] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.121616] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5c1580-3bd1-4d20-9bf1-0cc7e6186877 req-9db7243d-f822-4589-9df5-cdadbe0cff6b service nova] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 823.121616] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5c1580-3bd1-4d20-9bf1-0cc7e6186877 req-9db7243d-f822-4589-9df5-cdadbe0cff6b service nova] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 823.121782] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5c1580-3bd1-4d20-9bf1-0cc7e6186877 req-9db7243d-f822-4589-9df5-cdadbe0cff6b service nova] Enqueued Resource ID: 994cb153-0016-4afc-84d1-2f01ee11a6aa with Priority: HIGHEST for action port [ 823.123078] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_rules [ 823.123169] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 823.123327] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994cb153-0016-4afc-84d1-2f01ee11a6aa with Priority: HIGHEST for action port [ 823.123700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.123859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.124017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.124289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.124402] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.126249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.126393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.126497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.126828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.127109] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.127232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.127326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.127492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.127611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.127737] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.128784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-994cb153-0016-4afc-84d1-2f01ee11a6aa taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.128927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.129342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.129342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.129342] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('994cb153-0016-4afc-84d1-2f01ee11a6aa',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.390150] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.390399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.390507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.390779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.391023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.391123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.391179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.391306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.391395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.391525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.392008] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.392008] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.392008] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.392305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.392305] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.392436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.392436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.392545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.392690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.392795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.392866] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.633099] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.633099] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.633470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.635831] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 994cb153-0016-4afc-84d1-2f01ee11a6aa with status ACTIVE [ 823.636325] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.636325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.636325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.636555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.636603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.636773] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.637112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.637112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.637859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.637859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.637994] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.637994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.639105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.640100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.640100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.640100] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 994cb153-0016-4afc-84d1-2f01ee11a6aa is going to be updated. [ 823.680043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.680155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.680205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.680411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.680574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.680754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-994cb153-0016-4afc-84d1-2f01ee11a6aa" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.788753] env[65231]: INFO networking_nsxv3.common.synchronization [req-eb7aeadf-09bd-4e0a-afbc-fdb824c56b65 req-eb95f978-d355-4e46-81f4-2ddc69e049a4 tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 823.789864] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 823.790545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.790545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.791558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.791558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.791788] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.791788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.791788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.791954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.792059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.792152] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.895068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e382486-015d-44b8-a3e5-a0f228b61242: rpc.has_security_group_logging(os_id): False [ 823.914506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.914699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.914775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.914990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.915094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.915288] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.915385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.915440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.915734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.915734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.917181] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.918401] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.918401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.918401] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be created. [ 823.997658] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.997840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.997914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.998197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.998396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.013614] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 2s [ 824.134849] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.299854] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.300104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.300494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.328901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.329225] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.329364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.329526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.329726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.330263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.330720] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 824.360932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.361157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.361157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.361368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.361508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.370441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 824.638588] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.638588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.638588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.638588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.638588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.638588] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 is going to be created. [ 824.664685] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.664906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.664906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.665148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.665313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.680247] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: UNINITIALIZED for 2s [ 825.521070] env[65231]: INFO networking_nsxv3.common.synchronization [req-e2bd0880-05ca-4d0b-bfd5-e0ae58777649 req-0df24711-6c33-4f07-aebe-c720f1f164ae tempest-TenantUsagesTestJSON-1505704655 tempest-TenantUsagesTestJSON-1505704655-project-member] Enqueued Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 825.521497] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGHEST for action security_group_members [ 825.523635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.523635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.523635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.523635] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.028883] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 826.028883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.029010] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.029142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.029195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.029397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.029594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.029743] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.029862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.029912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.030126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.030167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.030247] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a is going to be updated. [ 826.057239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.057398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.057584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.058048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.058322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.067693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: IN_PROGRESS for 2s [ 826.383469] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 826.383857] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 deletion is rescheduled due to dependency. [ 826.383925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.744935] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: SUCCESS [ 826.745304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.745400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.745626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.745845] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.746082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.746082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.746263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.746347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.746449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.746543] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.253503] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.756594] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01960bce-f3a7-4830-a96e-89dc3cc30754: rpc.has_security_group_logging(os_id): False [ 827.777818] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.778011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.778080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.778259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.778346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.778582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.778684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.778746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.778890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.778963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.779059] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 is going to be created. [ 827.838502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.838775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.838775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.839192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.852147] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: IN_PROGRESS for 2s [ 828.078269] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a in Status: SUCCESS [ 828.078327] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a deletion is rescheduled due to dependency. [ 828.078436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.741562] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-867f6937-9ceb-4f7b-a823-3a5f801dc73d tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 828.741754] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 828.742074] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.742203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.742272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.742472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.742643] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.742745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.742807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.742957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.743056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.743152] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.056314] env[65231]: INFO networking_nsxv3.common.synchronization [req-a6d39dc7-1c38-4f9e-b30b-7f483e97097f req-057891a6-837d-46cc-b5ec-6c888c686613 tempest-FloatingIPsAssociationTestJSON-1925842782 tempest-FloatingIPsAssociationTestJSON-1925842782-project-member] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 829.056807] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGHEST for action security_group_members [ 829.057664] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.057664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.057664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.057998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.058468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.058644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.058758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.059022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.059304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.059304] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.099217] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.099502] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.099631] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.099897] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.100204] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.100379] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.100492] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.100820] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.101036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.101368] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.101508] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.101696] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.101784] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.101903] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.102015] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.102166] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.129027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.129027] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.129272] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.129765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.130272] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-9ab65d7b-8905-4583-85d7-0c73af26479e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.130511] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.130696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.131409] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.131409] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ab65d7b-8905-4583-85d7-0c73af26479e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.247715] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.247715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.247715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.247715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.270343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.270603] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.270758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.270986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.271080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.271178] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 829.297501] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.297713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.297713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.297925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.298096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310800] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 829.569285] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.569480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.569800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.570361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.591324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.591621] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.591723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.591723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.591963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.592075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.592166] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be updated. [ 829.621020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.621020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.621020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.621020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.621020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.640021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: IN_PROGRESS for 2s [ 829.640021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.640021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 9ab65d7b-8905-4583-85d7-0c73af26479e not found, creating... [ 829.640021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.640021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.640809] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.641278] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.641722] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.642069] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.642690] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.642690] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.642690] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.642816] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 9ab65d7b-8905-4583-85d7-0c73af26479e is going to be created. [ 829.661423] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.661738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.661817] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.662231] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.662334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.662530] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.864711] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: SUCCESS [ 829.864947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.417895] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-b1e52dbd-7ab1-480b-b07f-9f060b05ac7d service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 830.418207] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-b1e52dbd-7ab1-480b-b07f-9f060b05ac7d service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 830.418207] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-b1e52dbd-7ab1-480b-b07f-9f060b05ac7d service nova] Enqueued Resource ID: 9ab65d7b-8905-4583-85d7-0c73af26479e with Priority: HIGHEST for action port [ 830.418474] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 830.419752] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 830.420073] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab65d7b-8905-4583-85d7-0c73af26479e with Priority: HIGHEST for action port [ 830.420972] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.423945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.424054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.424267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.424354] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.425757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.425861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.426750] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ab65d7b-8905-4583-85d7-0c73af26479e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.426750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.426750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.426750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.426750] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ab65d7b-8905-4583-85d7-0c73af26479e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.927930] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.928094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.929879] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ab65d7b-8905-4583-85d7-0c73af26479e with status ACTIVE [ 830.930146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.930271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.930337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.930552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.930677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.930931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.931059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.931126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.931315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.931360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.931538] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.931757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.931757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.931878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.931913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.932030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ab65d7b-8905-4583-85d7-0c73af26479e is going to be updated. [ 830.957229] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.957403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.957453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.957663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ab65d7b-8905-4583-85d7-0c73af26479e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.325244] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 831.325244] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd deletion is rescheduled due to dependency. [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.325244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.325244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.325802] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.650259] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 in Status: SUCCESS [ 831.650259] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 deletion is rescheduled due to dependency. [ 831.650259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.829471] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.332419] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.835280] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.835603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.835603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.835800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.835893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.836009] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 832.866562] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.866658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.866699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.866913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.867077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.878146] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 834.894362] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 834.894809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.894809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.895047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.895194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.895306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.895366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.895523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.895599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.895677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.895851] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.398376] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.398796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.398923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.399204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.399530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.399708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.399773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.399943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.400063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.400157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.400310] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.400407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.400608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.400608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.400789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.400847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.400891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.401014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.401092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.401172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.401257] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.421299] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 835.421515] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 835.903905] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd: rpc.has_security_group_logging(os_id): False [ 835.923536] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.923536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.923536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.923848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.923916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.924213] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.924394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.924506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.925577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.925577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.925577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.925577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.925577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.925577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.926056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.926056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.926224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.926224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.926400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.926584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.926671] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 836.022865] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-7eb4c5fd-7bf0-4b4b-affe-6db8cee40a02 tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 836.023524] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 836.023835] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.023963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.024146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.025230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.025230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.025230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.025230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.025230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.025230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.025230] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.028555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.028555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.028555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.028835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.028835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.045811] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 836.492321] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.492509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.492692] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.492969] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.493280] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.493439] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.493556] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.493773] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.493916] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.494136] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.494247] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.494350] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.494469] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.494548] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.494652] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.494786] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.514177] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.514349] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.514667] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.514858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.515255] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.515444] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.515565] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.515880] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.516080] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe3c47d-6a52-4ea3-b976-424ccbb952c9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.531613] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.018627] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.019330] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.019330] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.019330] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.019579] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.019654] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port dbe3c47d-6a52-4ea3-b976-424ccbb952c9 not found, creating... [ 837.019918] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.020205] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.020423] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.020559] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.020835] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020987] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.021115] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.021318] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.021446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.021629] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: dbe3c47d-6a52-4ea3-b976-424ccbb952c9 is going to be created. [ 837.033393] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.045485] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.045739] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.045819] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.046119] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.046348] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.046568] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.535699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.535878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.535952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.536189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.536270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.536374] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 837.576796] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.576986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.577078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.577234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.577446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.588693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 837.784187] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-9c2b89f7-c1fa-4a12-911c-2909f2e1e3e2 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 837.784299] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-9c2b89f7-c1fa-4a12-911c-2909f2e1e3e2 service nova] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 837.784438] env[65231]: INFO networking_nsxv3.common.synchronization [req-a895faa1-9e9a-4c34-96ed-3da0514f66a6 req-9c2b89f7-c1fa-4a12-911c-2909f2e1e3e2 service nova] Enqueued Resource ID: dbe3c47d-6a52-4ea3-b976-424ccbb952c9 with Priority: HIGHEST for action port [ 837.784985] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_rules [ 837.785341] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 837.785451] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe3c47d-6a52-4ea3-b976-424ccbb952c9 with Priority: HIGHEST for action port [ 837.785741] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.786093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.786093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.786237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.786718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.786846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.786914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.787137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.787216] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe3c47d-6a52-4ea3-b976-424ccbb952c9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.853564] env[65231]: INFO networking_nsxv3.common.synchronization [req-76500901-9524-4463-8686-11353a69a73a req-2c640be6-4ebc-4c2c-87e1-1f1f53db7731 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 837.853871] env[65231]: INFO networking_nsxv3.common.synchronization [req-76500901-9524-4463-8686-11353a69a73a req-2c640be6-4ebc-4c2c-87e1-1f1f53db7731 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 837.854153] env[65231]: INFO networking_nsxv3.common.synchronization [req-76500901-9524-4463-8686-11353a69a73a req-2c640be6-4ebc-4c2c-87e1-1f1f53db7731 tempest-SecurityGroupsTestJSON-154749176 tempest-SecurityGroupsTestJSON-154749176-project-member] Enqueued Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 837.855380] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGHEST for action security_group_members [ 837.855380] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGHEST for action security_group_members [ 837.855380] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 with Priority: HIGHEST for action security_group_members [ 837.856460] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.856460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.856460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.856460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.856460] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.856460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.856460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.857121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.857121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.857236] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.858399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.858596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.858720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.859105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.859331] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.859504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.859696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.859997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.860190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.860357] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.861676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01685928-70c6-4a4e-8584-3fbdbe9910e3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.861837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.861971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.862214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.862410] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.862547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.862663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.862852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.863017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.863167] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01685928-70c6-4a4e-8584-3fbdbe9910e3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.059959] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 838.059959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.059959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.059959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.060483] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.289042] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbe3c47d-6a52-4ea3-b976-424ccbb952c9 with status ACTIVE [ 838.289298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.290030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.290030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.290030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.290030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.290265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.290401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.290501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.290805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.290887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.291160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.291318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.291428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.291591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.291731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.291822] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbe3c47d-6a52-4ea3-b976-424ccbb952c9 is going to be updated. [ 838.312868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.313125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.313204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.313395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.314836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.314836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe3c47d-6a52-4ea3-b976-424ccbb952c9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.367088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.367257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.367352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.367587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.370319] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.370319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.370319] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.370319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.409126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.411053] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.411053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.411053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.411053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.411053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.411053] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be updated. [ 838.412238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.414127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.448283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.448283] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.448283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.448283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.448283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.448283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.448785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b is going to be updated. [ 838.449423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.449641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.449708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.449901] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.450020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.450083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.450484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.450484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.450484] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 is going to be updated. [ 838.464771] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.464978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.464978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.465242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.465378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.476407] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: IN_PROGRESS for 2s [ 838.495170] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.495304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.495364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.495576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.495729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.502378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.502598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.502598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.503304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.503304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.515892] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: IN_PROGRESS for 2s [ 838.516861] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: IN_PROGRESS for 2s [ 838.562021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.562225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705808] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fa4787c-07b2-42ca-b2d6-5e268c904eb5 req-74d6b488-9c32-4b22-a221-2a13ebe11303 tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 838.706142] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 838.706476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.706601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.706666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.706930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.707584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.707716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.707777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.707929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.708027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708130] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.053752] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.053962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.055946] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.056391] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.056709] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.057219] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.057219] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.057427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.057600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.057840] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.057960] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.058080] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.058330] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.058400] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.058541] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.058762] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.078657] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.079318] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.079604] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.080038] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.080486] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.081158] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.081158] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.081585] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.082243] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.210183] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.210406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.210514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.210807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.210945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.211329] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.211421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.211520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.211827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.211901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.212043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae already deleted. [ 839.212241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.584450] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.584646] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.584786] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.585105] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.585289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.585543] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c not found, creating... [ 839.585811] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.586062] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.586156] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.586374] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.586526] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.586805] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.587000] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.587137] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.587340] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.587472] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.587655] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c is going to be created. [ 839.598647] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 839.598932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.599044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.599446] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.599555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.599646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.599787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.599861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.599956] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.609658] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.609658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.609658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.609658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.609658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.609658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.105854] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.401823] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fa4787c-07b2-42ca-b2d6-5e268c904eb5 req-7d9c796e-7302-4414-a39c-8a549b911623 service nova] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 840.401823] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fa4787c-07b2-42ca-b2d6-5e268c904eb5 req-7d9c796e-7302-4414-a39c-8a549b911623 service nova] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 840.402023] env[65231]: INFO networking_nsxv3.common.synchronization [req-9fa4787c-07b2-42ca-b2d6-5e268c904eb5 req-7d9c796e-7302-4414-a39c-8a549b911623 service nova] Enqueued Resource ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with Priority: HIGHEST for action port [ 840.403037] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 840.403037] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 840.403037] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with Priority: HIGHEST for action port [ 840.403222] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.403329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.403329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.403495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.403575] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.404499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.404860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.404860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.404934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.405040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.405129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.405189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.405333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.405418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.405562] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.406682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.406815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.406917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407261] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.488929] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df in Status: SUCCESS [ 840.489159] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df deletion is rescheduled due to dependency. [ 840.489275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.526877] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 in Status: SUCCESS [ 840.527043] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01685928-70c6-4a4e-8584-3fbdbe9910e3 deletion is rescheduled due to dependency. [ 840.527178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01685928-70c6-4a4e-8584-3fbdbe9910e3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.527900] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 048f7577-8ddf-44da-9165-34de6c108c3b in Status: SUCCESS [ 840.528213] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b deletion is rescheduled due to dependency. [ 840.528213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.609266] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.909425] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.910860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.910992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.911327] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with status ACTIVE [ 840.911327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.911903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.911903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.911903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.911903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.912979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.912979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.912979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.912979] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c is going to be updated. [ 840.935669] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.935824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.935906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.936156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.936316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.936483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.112663] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.113329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.113329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.113329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.113329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.113643] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 841.149555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.149850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.149850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.149966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.150128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.160545] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 841.415433] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.917704] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.917866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.917977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.918191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.918284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.918385] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae is going to be created. [ 841.941730] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.941911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.941995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.942179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.942339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.955061] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: UNINITIALIZED for 2s [ 843.173253] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 843.173538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.173673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.173912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.174140] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.174281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.174357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.174531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.174625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.174777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.174857] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.418192] env[65231]: INFO networking_nsxv3.common.synchronization [req-4c570511-cd37-490f-a52d-a84464dac95b req-6c297787-d569-4746-be22-30b7199f0e57 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 843.419050] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 843.419530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.419765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.419949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.420220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.420547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.420636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.420723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.420998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.421329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.421527] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.677591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.678094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.678094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.678229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.678332] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.679475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.679475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.679826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.679826] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.679826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.679952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.680079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.680166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.680252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.680368] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.763462] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.763647] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.763765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.764032] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.764287] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.764490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.764541] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.764746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.764887] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.765160] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.765273] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.765382] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.765486] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.765592] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.765694] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.765822] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.791516] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.792184] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.792346] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.792711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.793038] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-09ce7ddc-7ea9-41cd-8564-ad038da3f172 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.793309] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.793414] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.793735] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.793871] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ce7ddc-7ea9-41cd-8564-ad038da3f172',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.924980] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.925254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.925254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.925484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.925661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.925871] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.925971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.926050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.926230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.926306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.926452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d already deleted. [ 843.926558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.966908] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: SUCCESS [ 843.966908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.967091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.968457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.968457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.968457] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.183722] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd: rpc.has_security_group_logging(os_id): False [ 844.210272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.210272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.210272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.210272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.213042] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.213042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.213042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.213042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.213042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.213042] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 844.271832] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.271832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.271832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.271832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.271832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.289363] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 844.296278] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.296494] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.296619] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.296948] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.297128] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.297302] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 09ce7ddc-7ea9-41cd-8564-ad038da3f172 not found, creating... [ 844.297583] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.297743] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.297859] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.298094] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.298252] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.298530] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.298712] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.298920] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.299152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.299315] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.299493] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 09ce7ddc-7ea9-41cd-8564-ad038da3f172 is going to be created. [ 844.321208] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.321422] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.321571] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.321970] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.322314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.322580] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.470342] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.901734] env[65231]: INFO networking_nsxv3.common.synchronization [req-83498bdf-b7eb-4708-bbbd-2e82f983760f req-d043fdac-c402-4f95-b7dd-32587b1ee834 tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 844.903149] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 844.907104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.907303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.907397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.907620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.907808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.907907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.907969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.908138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.908230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.908367] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.973640] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e07d317b-0483-4445-8dd5-93a55bfaf9ae: rpc.has_security_group_logging(os_id): False [ 844.992115] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.992263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.992323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.992530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.992621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.992876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.992987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.993059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.993249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.993303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.993373] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae is going to be created. [ 845.046776] env[65231]: INFO networking_nsxv3.common.synchronization [req-4c570511-cd37-490f-a52d-a84464dac95b req-a23938b2-33fc-4b54-8680-681a6e6d8ab5 service nova] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 845.047561] env[65231]: INFO networking_nsxv3.common.synchronization [req-4c570511-cd37-490f-a52d-a84464dac95b req-a23938b2-33fc-4b54-8680-681a6e6d8ab5 service nova] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 845.049964] env[65231]: INFO networking_nsxv3.common.synchronization [req-4c570511-cd37-490f-a52d-a84464dac95b req-a23938b2-33fc-4b54-8680-681a6e6d8ab5 service nova] Enqueued Resource ID: 09ce7ddc-7ea9-41cd-8564-ad038da3f172 with Priority: HIGHEST for action port [ 845.050792] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_rules [ 845.050792] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 845.052506] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ce7ddc-7ea9-41cd-8564-ad038da3f172 with Priority: HIGHEST for action port [ 845.052506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.052506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.052506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.052506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.052506] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.053628] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.053628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.053628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.053628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.053758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.053962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.053962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.054066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.054150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.054242] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.055447] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-09ce7ddc-7ea9-41cd-8564-ad038da3f172 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.055550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.055612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.055832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.055932] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ce7ddc-7ea9-41cd-8564-ad038da3f172',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.062066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.062213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.062315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.062521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.062695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.078712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: IN_PROGRESS for 2s [ 845.410907] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.560673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560673] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.560673] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09ce7ddc-7ea9-41cd-8564-ad038da3f172 with status ACTIVE [ 845.560673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.560673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.560673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.561353] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.561353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.561353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.561353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.561353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.561353] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09ce7ddc-7ea9-41cd-8564-ad038da3f172 is going to be updated. [ 845.582512] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.584164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.584164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.584164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.584164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.584164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09ce7ddc-7ea9-41cd-8564-ad038da3f172" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.914020] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.063868] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.101378] env[65231]: INFO networking_nsxv3.common.synchronization [req-d5b709c6-b583-4fc1-bbb0-d9cf5e1f1392 req-f5c19620-e725-4497-9c7b-69396ccb5030 tempest-AttachInterfacesV270Test-376880105 tempest-AttachInterfacesV270Test-376880105-project-member] Enqueued Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 846.102045] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 846.102350] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.102506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.102585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.102908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.103255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.103395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.103959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.103959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.103959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.103959] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.308556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 846.308556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.417499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.417942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.417942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.418253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.418406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.418576] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 846.452691] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.452831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.452893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.453137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.453304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.464873] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 846.497610] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.497808] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-152" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.497975] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-152" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.498313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-152" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.498618] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.498862] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.498961] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.499267] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.499480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.499668] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.500105] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.500105] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.500105] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.500219] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.500300] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.500424] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.521258] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.521413] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.521712] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.522611] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-152" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.522611] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-43cb5536-2dba-4537-99a8-4e7e34847393 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.522611] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.522839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.523068] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.523234] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43cb5536-2dba-4537-99a8-4e7e34847393',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.566722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.566722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.566722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.566722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.566722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.566963] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d is going to be created. [ 846.591014] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.591188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.591287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.591463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.591619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.602925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: UNINITIALIZED for 2s [ 846.606739] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.606859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.606935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.607158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.607248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.607435] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.607552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.607613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.607765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.607904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.607948] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 already deleted. [ 846.608027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.025949] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.026232] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.026408] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.026738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.026950] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.027148] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 43cb5536-2dba-4537-99a8-4e7e34847393 not found, creating... [ 847.027425] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.027578] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.028066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.028760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.028760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.028917] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.029102] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.029220] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.029434] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.029620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.030231] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 43cb5536-2dba-4537-99a8-4e7e34847393 is going to be created. [ 847.052986] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.053228] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.053353] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.053631] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.053858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.054128] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.096600] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: SUCCESS [ 847.097030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.786142] env[65231]: INFO networking_nsxv3.common.synchronization [req-d5b709c6-b583-4fc1-bbb0-d9cf5e1f1392 req-60b160a5-8e32-42eb-b155-7684c8b41aa6 service nova] Enqueued Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_rules [ 847.786665] env[65231]: INFO networking_nsxv3.common.synchronization [req-d5b709c6-b583-4fc1-bbb0-d9cf5e1f1392 req-60b160a5-8e32-42eb-b155-7684c8b41aa6 service nova] Enqueued Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 847.786943] env[65231]: INFO networking_nsxv3.common.synchronization [req-d5b709c6-b583-4fc1-bbb0-d9cf5e1f1392 req-60b160a5-8e32-42eb-b155-7684c8b41aa6 service nova] Enqueued Resource ID: 43cb5536-2dba-4537-99a8-4e7e34847393 with Priority: HIGHEST for action port [ 847.787716] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_rules [ 847.787927] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 847.788140] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43cb5536-2dba-4537-99a8-4e7e34847393 with Priority: HIGHEST for action port [ 847.788644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.788941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.789126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.789498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.789677] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.791571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.792348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.792348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.792551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.792985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.793254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.793254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.793442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.793579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.793725] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.795670] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-43cb5536-2dba-4537-99a8-4e7e34847393 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.795670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.795670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.795670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.795670] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43cb5536-2dba-4537-99a8-4e7e34847393',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.887294] env[65231]: INFO networking_nsxv3.common.synchronization [req-f152f4c5-0a82-4db7-898c-78defa969065 req-1c0ca2e0-1fb3-4942-9e41-c8eae464195b tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 847.888212] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 847.888564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.888713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.888802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.889190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.889383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.889510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.889597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.889794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.889909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.890040] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.297612] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.299608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.299608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.299608] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43cb5536-2dba-4537-99a8-4e7e34847393 with status ACTIVE [ 848.299608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.299608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.300039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.300039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.300039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.301279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.301279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.301279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.301557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.301557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.301617] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43cb5536-2dba-4537-99a8-4e7e34847393 is going to be updated. [ 848.327894] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.328518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.328518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.328518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.328681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.329110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43cb5536-2dba-4537-99a8-4e7e34847393" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.337854] env[65231]: INFO networking_nsxv3.common.synchronization [req-43cbf11a-5d37-4075-8f40-f33198e1f5e0 req-aa4911a8-c8da-4b05-b0ec-75b4762939c3 tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 848.338800] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 848.339153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.339282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.339352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.339625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.339743] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.339846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.339908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.340089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.340178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.340276] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.392757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.392909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.392998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.393228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.393323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.393519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.393621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.394529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.394529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.394529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.394529] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be updated. [ 848.425795] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.425795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.425795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.425795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.425795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.444902] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 2s [ 848.480511] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 848.480768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.615499] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: SUCCESS [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.615499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.615499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.616426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.616781] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.663695] env[65231]: INFO networking_nsxv3.common.synchronization [req-c7956a46-ae05-4f51-af60-531b450302ec req-a973500e-ab52-45d4-a15e-7db9d08c74dd tempest-MultipleCreateTestJSON-239508593 tempest-MultipleCreateTestJSON-239508593-project-member] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 848.664499] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGHEST for action security_group_members [ 848.664825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.664932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.797364] env[65231]: INFO networking_nsxv3.common.synchronization [req-dcf55ead-3149-4b37-8aa0-50f029bc16ee req-6fdc5b9c-aba5-4274-b57c-57a62fb41483 tempest-ListImageFiltersTestJSON-1168737775 tempest-ListImageFiltersTestJSON-1168737775-project-member] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 848.797364] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 848.797364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.797364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.797364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.797364] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.800872] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.844027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.119567] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.301115] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.302307] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.302442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.302539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.302706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.302806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.302901] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 is going to be created. [ 849.329548] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.329548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.329766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.330331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.330331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.340917] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: UNINITIALIZED for 2s [ 849.344557] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.622784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d28923db-4093-40f3-b394-1a2f62eeee3d: rpc.has_security_group_logging(os_id): False [ 849.645408] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.645766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.645766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.645887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.645966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.646306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.646403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.646481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.646618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.646704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.646815] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d is going to be created. [ 849.735700] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.735700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.735700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.736182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.736182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.752552] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: IN_PROGRESS for 2s [ 849.805254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.847945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.847945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.847945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.848240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.848240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.848332] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 849.881436] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.881605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.881680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.881938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.882100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.896059] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 850.307800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.307971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.308081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.308344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.308439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.308628] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be updated. [ 850.344359] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.344515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.344574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.344766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.344913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.354699] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 850.454159] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 850.454360] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 deletion is rescheduled due to dependency. [ 850.454470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.350557] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: SUCCESS [ 851.350847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.351021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.351286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.351495] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.351628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.351694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.351917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.352020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.352137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.352249] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.770143] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: SUCCESS [ 851.770143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.854146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.854349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.854439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.854664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.854840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.856240] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.856240] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.856240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.856820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.856820] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.908608] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 851.908608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.908608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.908608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.908608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.909122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.909269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.909626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.909663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.910251] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.362609] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3effb6bd-b711-484f-a4bf-1ecdf2a28db6: rpc.has_security_group_logging(os_id): False [ 852.366078] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 852.366308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.379167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.379304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.379374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.379581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.379706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.379931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.380045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.380160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.380256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.380331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.380508] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.380596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.380657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.380792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.380866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.381093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.381190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.381253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.381390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.381482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.381577] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 is going to be created. [ 852.412892] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.414043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.414043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.414354] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be updated. [ 852.439519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.443018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.443018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.443018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.443018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.443361] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.443520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.443570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.443746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.447020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.454747] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: IN_PROGRESS for 2s [ 852.455556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: IN_PROGRESS for 2s [ 853.797127] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.797529] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 854.469066] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd in Status: SUCCESS [ 854.469255] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd deletion is rescheduled due to dependency. [ 854.469368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: SUCCESS [ 854.470693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.798463] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 858.798726] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 860.953474] env[65231]: INFO networking_nsxv3.common.synchronization [req-b341a972-6aaa-42ce-b23b-d259d8a7ef78 req-72221342-f8af-4c46-a5bd-c325d85940a4 tempest-AttachInterfacesV270Test-376880105 tempest-AttachInterfacesV270Test-376880105-project-member] Enqueued Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 860.954027] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 with Priority: HIGHEST for action security_group_members [ 860.954354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.954477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.954562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.954736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.954903] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.955010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.955072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.955217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.955304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.955392] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3effb6bd-b711-484f-a4bf-1ecdf2a28db6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.457976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.458140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.458210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.458416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.458506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.458699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.458798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.458856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.459010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.459091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.459174] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 is going to be updated. [ 861.488092] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.488331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.488331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.488520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.488665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.498287] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: IN_PROGRESS for 2s [ 863.509597] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 in Status: SUCCESS [ 863.510032] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3effb6bd-b711-484f-a4bf-1ecdf2a28db6 deletion is rescheduled due to dependency. [ 863.510032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3effb6bd-b711-484f-a4bf-1ecdf2a28db6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.063367] env[65231]: INFO networking_nsxv3.common.synchronization [req-b1530bea-a1b4-4c44-83da-8ba9a7acaea3 req-4f9b097b-1bac-4d1b-8515-40b1134181d8 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 864.063916] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 864.064256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.064381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.064448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.064704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.064867] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.064965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.065039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.065192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.065275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.065369] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.145389] env[65231]: INFO networking_nsxv3.common.synchronization [req-de672da9-47ad-45a5-bb9d-bafea43167f7 req-b5f367c0-f9b6-477b-ba8b-f68893ac0129 tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 864.146260] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 864.146828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.147022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.147120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.147362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.147565] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.147694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.147793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.148011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.148169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.148293] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.451644] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.451890] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.452038] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.452352] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.452603] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.452755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.452872] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.453126] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.453270] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.453473] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.453584] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.453689] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.453795] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.453899] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.454006] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.454145] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.478388] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.478388] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.478388] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.478388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.478554] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-d6312777-b9a9-4a53-93a1-dc4416055a13 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.478632] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.479028] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.479095] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.479231] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6312777-b9a9-4a53-93a1-dc4416055a13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.570477] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.570821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.570821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.570892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.571461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.571461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.571461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.571461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.571461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.571772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.571772] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 already deleted. [ 864.571772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.651072] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.982482] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.982482] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.982482] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.982746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.982929] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.983918] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port d6312777-b9a9-4a53-93a1-dc4416055a13 not found, creating... [ 864.983918] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.983918] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.983918] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.984884] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.984884] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.984884] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.985150] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.985361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.985653] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.985884] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.986941] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: d6312777-b9a9-4a53-93a1-dc4416055a13 is going to be created. [ 865.012511] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.012746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.012877] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.013188] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.013542] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.013733] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.153372] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.656418] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.656736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.656736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.656852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.657036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.657094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 865.699063] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.699279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.699279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.699591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.699687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.710449] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 865.714371] env[65231]: INFO networking_nsxv3.common.synchronization [req-b1530bea-a1b4-4c44-83da-8ba9a7acaea3 req-9bb2b9cb-5a1c-4f41-8f11-d1252c4378ed service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 865.714371] env[65231]: INFO networking_nsxv3.common.synchronization [req-b1530bea-a1b4-4c44-83da-8ba9a7acaea3 req-9bb2b9cb-5a1c-4f41-8f11-d1252c4378ed service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 865.714371] env[65231]: INFO networking_nsxv3.common.synchronization [req-b1530bea-a1b4-4c44-83da-8ba9a7acaea3 req-9bb2b9cb-5a1c-4f41-8f11-d1252c4378ed service nova] Enqueued Resource ID: d6312777-b9a9-4a53-93a1-dc4416055a13 with Priority: HIGHEST for action port [ 865.714573] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 865.714682] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 865.714779] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6312777-b9a9-4a53-93a1-dc4416055a13 with Priority: HIGHEST for action port [ 865.715667] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.715667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.715667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.715873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.715943] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.716876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.716991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.717084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.717246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.717424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.717495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.717543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.718826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.718826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.718826] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.718826] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6312777-b9a9-4a53-93a1-dc4416055a13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.718826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.718826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.719582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.719582] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6312777-b9a9-4a53-93a1-dc4416055a13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.220975] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.222406] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.222526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.222663] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6312777-b9a9-4a53-93a1-dc4416055a13 with status ACTIVE [ 866.222830] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.222936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.223019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.223231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.223315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.223485] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.223590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.223643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.223803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.223953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.224243] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.224358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.224730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.224730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.224730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.224863] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6312777-b9a9-4a53-93a1-dc4416055a13 is going to be updated. [ 866.246180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.246362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.246401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.246602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.246737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.246903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6312777-b9a9-4a53-93a1-dc4416055a13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.606252] env[65231]: INFO networking_nsxv3.common.synchronization [req-cf96af4e-6398-42d3-ad6a-ec34bc90bded req-e2ec8266-f2d7-4203-9e0b-36c4d725e7e2 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 866.606905] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 866.607522] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.607600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.607634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.607971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.608202] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.608329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.608412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.609107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.609107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.609107] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.727758] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.928042] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.928042] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.928042] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.928042] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.928042] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.928042] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.928042] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.928687] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.928961] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.929298] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.931620] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.931620] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.931620] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.931620] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.931620] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.931620] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.948505] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.948856] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.949218] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.951083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.951083] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.951083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.951083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.951083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.951083] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6af22a-06c4-4a5a-8b70-9d567c4a4719',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.112250] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.112560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.112678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.113027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.113183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.113479] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.113609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.113703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.113929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.114073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.114175] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b already deleted. [ 867.114653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.230254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.230411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.230481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.230693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.230784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.230892] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be created. [ 867.254185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.254327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.254993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.254993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.254993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.266675] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: UNINITIALIZED for 2s [ 867.454059] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.454254] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.454469] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.454803] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.454992] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.455200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 not found, creating... [ 867.455490] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.455677] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.455847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.456101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.456245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.456525] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.456675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.456792] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.456995] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.457140] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.457275] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 is going to be created. [ 867.481700] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.481977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.482122] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.482388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.482615] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.482842] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.720964] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 867.721284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.219753] env[65231]: INFO networking_nsxv3.common.synchronization [req-cf96af4e-6398-42d3-ad6a-ec34bc90bded req-da6bf5f0-9329-4542-91b9-fcbfd1ab1981 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 868.220020] env[65231]: INFO networking_nsxv3.common.synchronization [req-cf96af4e-6398-42d3-ad6a-ec34bc90bded req-da6bf5f0-9329-4542-91b9-fcbfd1ab1981 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 868.220115] env[65231]: INFO networking_nsxv3.common.synchronization [req-cf96af4e-6398-42d3-ad6a-ec34bc90bded req-da6bf5f0-9329-4542-91b9-fcbfd1ab1981 service nova] Enqueued Resource ID: 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 with Priority: HIGHEST for action port [ 868.220616] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 868.220748] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 868.220843] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 with Priority: HIGHEST for action port [ 868.221291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.221291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.221475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.221583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.221664] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.223336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.223492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.223586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.223789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.224680] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.224680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.224680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.224680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.224680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.224680] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.225433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.225780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.225780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.225780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.225871] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6af22a-06c4-4a5a-8b70-9d567c4a4719',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.727410] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.727590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.728027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.729106] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 with status ACTIVE [ 868.729374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.729558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.729679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.729976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.730082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.730295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.730407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.730472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.730640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.730727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.730910] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.731038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.731132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.731339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.731425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.731512] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d6af22a-06c4-4a5a-8b70-9d567c4a4719 is going to be updated. [ 868.766057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.766405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.766486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.766699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.766836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.766995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d6af22a-06c4-4a5a-8b70-9d567c4a4719" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.234253] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.278276] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 869.278533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.278717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.278935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.279162] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.279299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.279353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.279469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.279549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.279634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.279724] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.316190] env[65231]: INFO networking_nsxv3.common.synchronization [req-4990a36f-1336-446b-9950-c3f26555b72f req-47b2b23e-1ef5-4667-84d1-9513c42a8bd4 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 869.316767] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 869.322252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.322666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.737693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.737951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.738161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.738385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.738529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.738685] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be created. [ 869.760234] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.760234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.760234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.760234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.760516] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.760613] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.760725] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.760965] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.761131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.761339] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.761450] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.761558] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.761663] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.761789] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.762171] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.762381] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.768644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.768818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.768878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.769149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.769264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.782763] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.782924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.783234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.783234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.783417] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.784323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.784407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.784605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.784701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.784796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.784965] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.785099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.785163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.785678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.785678] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.785678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.785678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.785868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.785868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.785931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.785984] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.787705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: UNINITIALIZED for 2s [ 869.797700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.798547] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.798547] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.799293] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.799293] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-d569cb1f-291b-41b2-8655-e303f6bf8d04 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.799293] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.799293] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.799655] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.799655] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d569cb1f-291b-41b2-8655-e303f6bf8d04',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.289241] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e543173b-3aa1-49c7-bec7-ab450397ef46: rpc.has_security_group_logging(os_id): False [ 870.304918] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.305372] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.305609] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.305974] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.306299] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.306582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port d569cb1f-291b-41b2-8655-e303f6bf8d04 not found, creating... [ 870.309174] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.309342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.309389] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.309690] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.309868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.310570] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.310570] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.310570] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.310913] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.310960] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.311189] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: d569cb1f-291b-41b2-8655-e303f6bf8d04 is going to be created. [ 870.313401] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.313527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.313620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.313776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.313861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.314079] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.314193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.314243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.314804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.314804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.314804] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.314804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.314804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.316218] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.316218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.316218] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be created. [ 870.341345] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.341345] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.341345] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.341345] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.341647] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.341676] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.383532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.383776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.383892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.384181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.384502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.400296] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 871.034995] env[65231]: INFO networking_nsxv3.common.synchronization [req-4990a36f-1336-446b-9950-c3f26555b72f req-eebe1db6-fa2e-440d-8ff4-ad5472e20779 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 871.034995] env[65231]: INFO networking_nsxv3.common.synchronization [req-4990a36f-1336-446b-9950-c3f26555b72f req-eebe1db6-fa2e-440d-8ff4-ad5472e20779 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 871.034995] env[65231]: INFO networking_nsxv3.common.synchronization [req-4990a36f-1336-446b-9950-c3f26555b72f req-eebe1db6-fa2e-440d-8ff4-ad5472e20779 service nova] Enqueued Resource ID: d569cb1f-291b-41b2-8655-e303f6bf8d04 with Priority: HIGHEST for action port [ 871.035471] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 871.035612] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 871.035711] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569cb1f-291b-41b2-8655-e303f6bf8d04 with Priority: HIGHEST for action port [ 871.036269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.036269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.036269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.036417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.036533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d569cb1f-291b-41b2-8655-e303f6bf8d04 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.036617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.036687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.036978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.037087] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d569cb1f-291b-41b2-8655-e303f6bf8d04',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.539746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d569cb1f-291b-41b2-8655-e303f6bf8d04 with status ACTIVE [ 871.540564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.540925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.541107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.541397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.541595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.541933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.543885] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.543885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.543885] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d569cb1f-291b-41b2-8655-e303f6bf8d04 is going to be updated. [ 871.567227] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.567227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.567227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.567694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.568112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.568218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d569cb1f-291b-41b2-8655-e303f6bf8d04" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.807064] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 871.807339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.807518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.807767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.808026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.808159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.808240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.808407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.808507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.808596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.808696] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.810634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.810808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.810982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.811106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.811168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.811309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.811418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.811472] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.315231] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.315357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.315574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.415186] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 872.415559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.821209] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.325646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.325816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.325884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.326119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.326200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.326317] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 873.354593] env[65231]: INFO networking_nsxv3.common.synchronization [None req-6a1bd8d3-cbc4-40b8-89a8-859c5ce38ff8 None None] Enqueued Resource ID: 80784d14-f121-46af-a1d7-0d1524cc10cb with Priority: HIGHEST for action port [ 873.355136] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80784d14-f121-46af-a1d7-0d1524cc10cb with Priority: HIGHEST for action port [ 873.355531] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-80784d14-f121-46af-a1d7-0d1524cc10cb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.355771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80784d14-f121-46af-a1d7-0d1524cc10cb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.355894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80784d14-f121-46af-a1d7-0d1524cc10cb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.356203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80784d14-f121-46af-a1d7-0d1524cc10cb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.356357] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80784d14-f121-46af-a1d7-0d1524cc10cb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.358012] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.358203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.358354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.358548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.358888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.369030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 873.861285] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80784d14-f121-46af-a1d7-0d1524cc10cb [ 873.861729] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.861729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.861729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.862143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.862230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.862350] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80784d14-f121-46af-a1d7-0d1524cc10cb already deleted. [ 873.862441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80784d14-f121-46af-a1d7-0d1524cc10cb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.527599] env[65231]: INFO networking_nsxv3.common.synchronization [req-e2c79283-723e-4629-9847-641488f90562 req-31949458-a60d-422a-ba42-5bdf4dc3b9c7 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 874.527599] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 874.527599] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.527838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.907965] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.908287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.908287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.908581] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.908832] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.908991] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.910420] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.910420] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.910420] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.910560] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.910560] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.910708] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.910825] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.910967] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.911096] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.911231] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.932632] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.932808] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.932954] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.933191] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-925" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.933679] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-f2c4e7de-3a67-4353-a64e-23150eccb5b8 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.933679] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.933855] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.934223] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.934337] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c4e7de-3a67-4353-a64e-23150eccb5b8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.384392] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 875.384702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.384897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.385135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.385360] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.385555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.385779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.385864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.385936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.386140] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.439397] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.439712] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.439937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.440295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.440487] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.440675] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port f2c4e7de-3a67-4353-a64e-23150eccb5b8 not found, creating... [ 875.441142] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.441379] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441524] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.441822] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.442102] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.442503] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.442703] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.442898] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.443217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.443588] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.443652] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: f2c4e7de-3a67-4353-a64e-23150eccb5b8 is going to be created. [ 875.468320] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.468717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.468978] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.469455] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.469902] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.470324] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.861817] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e87c61e9-0f70-4c3c-91f4-6f1e46083d27 None None] Enqueued Resource ID: 8f13d261-52be-46d9-aab7-767c37e5b00b with Priority: HIGHEST for action port [ 875.862211] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f13d261-52be-46d9-aab7-767c37e5b00b with Priority: HIGHEST for action port [ 875.862717] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f13d261-52be-46d9-aab7-767c37e5b00b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.862845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f13d261-52be-46d9-aab7-767c37e5b00b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.862930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f13d261-52be-46d9-aab7-767c37e5b00b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.865529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f13d261-52be-46d9-aab7-767c37e5b00b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.865616] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f13d261-52be-46d9-aab7-767c37e5b00b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.889552] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.168502] env[65231]: INFO networking_nsxv3.common.synchronization [req-e2c79283-723e-4629-9847-641488f90562 req-061842d4-68c2-404d-9d51-80794df11295 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 876.168502] env[65231]: INFO networking_nsxv3.common.synchronization [req-e2c79283-723e-4629-9847-641488f90562 req-061842d4-68c2-404d-9d51-80794df11295 service nova] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 876.169398] env[65231]: INFO networking_nsxv3.common.synchronization [req-e2c79283-723e-4629-9847-641488f90562 req-061842d4-68c2-404d-9d51-80794df11295 service nova] Enqueued Resource ID: f2c4e7de-3a67-4353-a64e-23150eccb5b8 with Priority: HIGHEST for action port [ 876.169398] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_rules [ 876.169398] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 876.169398] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c4e7de-3a67-4353-a64e-23150eccb5b8 with Priority: HIGHEST for action port [ 876.169668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.169756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.170932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.171066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.173276] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c4e7de-3a67-4353-a64e-23150eccb5b8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.173276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.173472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.173536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.173593] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c4e7de-3a67-4353-a64e-23150eccb5b8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.368173] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f13d261-52be-46d9-aab7-767c37e5b00b [ 876.368429] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.368615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.368615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.368864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.369114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f13d261-52be-46d9-aab7-767c37e5b00b already deleted. [ 876.369223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f13d261-52be-46d9-aab7-767c37e5b00b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.391753] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.675878] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c4e7de-3a67-4353-a64e-23150eccb5b8 with status ACTIVE [ 876.675878] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.675878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.675878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.675878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.676203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.676278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.676720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.676720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.676720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.676720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.676875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.676923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.676971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.677130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.677201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.677288] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c4e7de-3a67-4353-a64e-23150eccb5b8 is going to be updated. [ 876.703650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.705110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.705110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.705110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.705110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.705110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c4e7de-3a67-4353-a64e-23150eccb5b8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.895356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.895499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.895573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.895840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.895968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.896051] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 876.928119] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.928304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.928433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.928758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.928941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.941934] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 878.378024] env[65231]: INFO networking_nsxv3.common.synchronization [req-dca5cec3-ca3e-41b9-8d70-e22c7cf0b621 req-34adaf50-bdfa-48d1-aaa9-58a2417d71c3 tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 878.379208] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 878.379208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.379208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.379208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.380229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.380229] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.380229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.380229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.380462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.380462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.380542] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.885521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.885728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.885728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.886098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.886098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.886098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.886348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.886348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.886348] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 878.935021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.935021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.935021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.935021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.935021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.945793] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 878.954132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 878.954475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.954705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.954869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.955108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.955637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.955725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.955885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.955968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.956069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.956323] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.956378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.956494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.956696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.956696] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.956803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.956857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.956991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.957172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.957271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.957523] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.958451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.958451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.958941] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.958941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.958941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.958941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.959120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.959120] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.963013] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.963217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.963342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.963675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.963931] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.964448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.964606] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.964873] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.965012] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.965200] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.965329] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.965440] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.965546] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.965654] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.965758] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.965888] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.004022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.004202] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.004371] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.004552] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-982" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.004871] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-551214b4-3730-4685-b573-637b9c0007ce taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.005084] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.005210] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.005544] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.005745] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('551214b4-3730-4685-b573-637b9c0007ce',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.460942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f59524d0-6c69-4693-8189-3ea92184056b: rpc.has_security_group_logging(os_id): False [ 879.464570] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.492087] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.492336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.492411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.492621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.492708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.492973] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.493633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.493633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.493633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.493633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.493633] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.494072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.494072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.494072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.494163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.494547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.494895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.494969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.495312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.495312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.495425] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be created. [ 879.508196] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.508521] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.508648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.509120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.509242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.509512] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 551214b4-3730-4685-b573-637b9c0007ce not found, creating... [ 879.509879] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.511289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.511289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.511289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.511289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.511543] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.511776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.511937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.512208] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.512351] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.512497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 551214b4-3730-4685-b573-637b9c0007ce is going to be created. [ 879.532904] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.533118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.533118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.533403] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.533637] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.534776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.593280] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.593471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.593542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.593762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.593962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.614769] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 879.967095] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.309925] env[65231]: INFO networking_nsxv3.common.synchronization [req-dca5cec3-ca3e-41b9-8d70-e22c7cf0b621 req-bf5a3b60-d15b-4db7-bef0-a04381fe6618 service nova] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 880.310121] env[65231]: INFO networking_nsxv3.common.synchronization [req-dca5cec3-ca3e-41b9-8d70-e22c7cf0b621 req-bf5a3b60-d15b-4db7-bef0-a04381fe6618 service nova] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 880.310260] env[65231]: INFO networking_nsxv3.common.synchronization [req-dca5cec3-ca3e-41b9-8d70-e22c7cf0b621 req-bf5a3b60-d15b-4db7-bef0-a04381fe6618 service nova] Enqueued Resource ID: 551214b4-3730-4685-b573-637b9c0007ce with Priority: HIGHEST for action port [ 880.310495] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_rules [ 880.310620] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 880.310713] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551214b4-3730-4685-b573-637b9c0007ce with Priority: HIGHEST for action port [ 880.311290] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.311429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.311500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.311664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.311742] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.312952] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.313089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.313408] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-551214b4-3730-4685-b573-637b9c0007ce taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.313519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.313584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.313758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.313827] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('551214b4-3730-4685-b573-637b9c0007ce',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.472574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.472886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.472886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.473054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.473237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.473307] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 880.507745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.507745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.507861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.508884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.508884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.520121] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 880.817495] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 551214b4-3730-4685-b573-637b9c0007ce with status ACTIVE [ 880.820141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.820141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.820141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.820141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.820141] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 551214b4-3730-4685-b573-637b9c0007ce is going to be updated. [ 880.822812] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.822812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.849117] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.849566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.849566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.849566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.849732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.849942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-551214b4-3730-4685-b573-637b9c0007ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.960331] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 880.960434] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 deletion is rescheduled due to dependency. [ 880.960542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.960729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.960930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.961157] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.961298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.961330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.961467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.961546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.961634] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.465118] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.631968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 881.632347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.632490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.632709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.632798] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.972746] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.010392] env[65231]: INFO networking_nsxv3.common.synchronization [None req-78190626-c31e-42e3-ac66-e669b322f0bd None None] Enqueued Resource ID: a1cb2cb0-8f25-439f-8511-0342496ad432 with Priority: HIGHEST for action port [ 882.011419] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cb2cb0-8f25-439f-8511-0342496ad432 with Priority: HIGHEST for action port [ 882.011691] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1cb2cb0-8f25-439f-8511-0342496ad432 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.011943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1cb2cb0-8f25-439f-8511-0342496ad432" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.011943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1cb2cb0-8f25-439f-8511-0342496ad432" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.012206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1cb2cb0-8f25-439f-8511-0342496ad432" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.012291] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1cb2cb0-8f25-439f-8511-0342496ad432',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.135265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.135483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.476229] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.476976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.477163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.477323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.477441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.477866] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 882.515289] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.515289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.515289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.515696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.515967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.517547] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1cb2cb0-8f25-439f-8511-0342496ad432 [ 882.517886] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.518392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.518580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.519719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.519719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.519719] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1cb2cb0-8f25-439f-8511-0342496ad432 already deleted. [ 882.519719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1cb2cb0-8f25-439f-8511-0342496ad432" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.535350] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 882.535350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.536599] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 882.538020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.538020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.538020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.538020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.538020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.539440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.539440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.539440] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.043237] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.547448] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.790492] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-1559b1af-7018-4d04-a9d3-d4ffd774d690 tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 883.790492] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 883.790492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.790492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.790492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.790492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.790492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.791492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.791689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.791967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.792188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.792374] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.053503] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.053503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.053503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.053503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.053503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.053503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 884.092421] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.092899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.093221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.093542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.093812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.108234] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 884.289699] env[65231]: INFO networking_nsxv3.common.synchronization [None req-938d2e36-11fa-41a5-9ddb-2181f5bbdb18 None None] Enqueued Resource ID: 91a5c950-13c1-4096-9d86-46fbab660ba3 with Priority: HIGHEST for action port [ 884.292147] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a5c950-13c1-4096-9d86-46fbab660ba3 with Priority: HIGHEST for action port [ 884.292638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a5c950-13c1-4096-9d86-46fbab660ba3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.292829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a5c950-13c1-4096-9d86-46fbab660ba3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.292964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a5c950-13c1-4096-9d86-46fbab660ba3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.293632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a5c950-13c1-4096-9d86-46fbab660ba3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.293764] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a5c950-13c1-4096-9d86-46fbab660ba3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.297825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.298090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.298231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.298559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.298725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.299053] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.299221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.299324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.299600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.299769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.299814] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 884.337080] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.337697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.337697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.337697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.337892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.354527] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 884.547948] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 884.548737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.550325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.550589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.551620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.551814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.551897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.552208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.552308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.552477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.552658] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.723323] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-46250c67-0a73-4973-a108-95eb15ca4f5b tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 884.723991] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 884.724626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.724729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.799358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91a5c950-13c1-4096-9d86-46fbab660ba3 [ 884.799358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.799823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.799823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.799823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.799823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.800132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91a5c950-13c1-4096-9d86-46fbab660ba3 already deleted. [ 884.800132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a5c950-13c1-4096-9d86-46fbab660ba3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.969169] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f77e00ac-e964-4e7f-a301-87b135306dd8 None None] Enqueued Resource ID: eb00ed81-df2a-454c-b8b3-889f570be334 with Priority: HIGHEST for action port [ 884.969715] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb00ed81-df2a-454c-b8b3-889f570be334 with Priority: HIGHEST for action port [ 884.970057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb00ed81-df2a-454c-b8b3-889f570be334 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.970183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb00ed81-df2a-454c-b8b3-889f570be334" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.970252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb00ed81-df2a-454c-b8b3-889f570be334" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.973751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb00ed81-df2a-454c-b8b3-889f570be334" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.973873] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb00ed81-df2a-454c-b8b3-889f570be334',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.056833] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.218077] env[65231]: INFO networking_nsxv3.common.synchronization [req-1076fa6c-ed78-4cc6-a412-5597073c7a96 req-4248db3d-8175-4e1c-8fcf-37ac17a6b470 tempest-ServersV294TestFqdnHostnames-472328194 tempest-ServersV294TestFqdnHostnames-472328194-project-member] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 885.218077] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGHEST for action security_group_members [ 885.218437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.218771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.218928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.219236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.219492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.219713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.219853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.220156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.220346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.220537] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.471643] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.472016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-154" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.472287] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-154" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.472882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-154" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.473167] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.473412] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.473645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.473997] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.474208] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.474531] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.474621] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.474737] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.474890] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.475255] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.475454] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.475640] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.477776] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb00ed81-df2a-454c-b8b3-889f570be334 [ 885.479028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.479299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.479360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.479763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.479894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.480103] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb00ed81-df2a-454c-b8b3-889f570be334 already deleted. [ 885.480209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb00ed81-df2a-454c-b8b3-889f570be334" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.501376] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.501824] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.502902] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.503330] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-154" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.503810] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.505017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.505017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.505017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.505017] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.557537] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c15aec1a-6b31-4260-9fa5-1dd741dd95c5: rpc.has_security_group_logging(os_id): False [ 885.583624] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.583797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.583835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.584065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.584157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.584400] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.584500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.584564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.584724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.584798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.584884] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 885.667040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.667040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.667040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.667040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.667297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.686029] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 885.688525] env[65231]: INFO networking_nsxv3.common.synchronization [req-cbbc112a-43ef-4925-ad9a-3b2f21fc1c07 req-0c359763-84e9-436c-b150-41f2386c93dd tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 885.688776] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 885.689531] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.689531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.689531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.689756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.690306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.690306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.690306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.690306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.690469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.690527] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.724870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.724967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.725415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.725415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.753985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.754302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.754412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.754450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.754654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.754733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.754820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b is going to be updated. [ 885.799620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.799892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.799892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.800190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.800352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.809964] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: IN_PROGRESS for 2s [ 886.008812] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.009080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.009212] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.009720] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.009878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.010093] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 not found, creating... [ 886.010387] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.010667] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.010667] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.010893] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.011063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.011364] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.011517] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.014592] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.014805] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.015044] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.015269] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 is going to be created. [ 886.021772] env[65231]: INFO networking_nsxv3.common.synchronization [req-32d26751-4c56-44e9-bd4f-ea402981169e req-12d01743-3254-4ff4-b50f-184742632e5b tempest-ListImageFiltersTestJSON-1168737775 tempest-ListImageFiltersTestJSON-1168737775-project-member] Enqueued Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 886.023036] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86218e2b-505b-489d-9831-63e52af66c10 with Priority: HIGHEST for action security_group_members [ 886.023385] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-86218e2b-505b-489d-9831-63e52af66c10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.023795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.023795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.023795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.023940] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.023987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.024075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.024231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.024442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.024442] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86218e2b-505b-489d-9831-63e52af66c10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.043392] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.043797] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.043797] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.044092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.044334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.044578] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.118687] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 886.119042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.119083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.119283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.119480] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.119602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.119672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.119917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.120082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.120180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.120274] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.192868] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.276962] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b54a2aaa-4e04-4fb4-8768-362d60c67551 None None] Enqueued Resource ID: 2b88323d-2ddd-440f-9b34-73f062646ba5 with Priority: HIGHEST for action port [ 886.277565] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b88323d-2ddd-440f-9b34-73f062646ba5 with Priority: HIGHEST for action port [ 886.277911] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b88323d-2ddd-440f-9b34-73f062646ba5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.278053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b88323d-2ddd-440f-9b34-73f062646ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.278124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b88323d-2ddd-440f-9b34-73f062646ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.278386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b88323d-2ddd-440f-9b34-73f062646ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.278494] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b88323d-2ddd-440f-9b34-73f062646ba5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.363896] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 886.364155] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 deletion is rescheduled due to dependency. [ 886.364224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.364413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.364638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.364822] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.364942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.365017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.365210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.365265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.365351] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.528485] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.528620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.528916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.529267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.550636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.550890] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.551027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.551099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.551443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.551443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.551533] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 is going to be updated. [ 886.608971] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.609133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.609202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.609408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.609553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.623103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.623103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.623103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.623103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.623415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.623415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.623415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.624042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.624042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.624042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.624042] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.624042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.624042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.624274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.624329] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.624451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.624482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.624603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.624677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.624755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.624840] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.634015] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: IN_PROGRESS for 2s [ 886.697440] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.783301] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b88323d-2ddd-440f-9b34-73f062646ba5 [ 886.783301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.783301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.783301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.783301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.783481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.783481] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b88323d-2ddd-440f-9b34-73f062646ba5 already deleted. [ 886.783539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b88323d-2ddd-440f-9b34-73f062646ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.784435] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-78a3f375-9b55-4f34-af21-f6b56fda45b3 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 886.784605] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-78a3f375-9b55-4f34-af21-f6b56fda45b3 service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 886.784739] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-78a3f375-9b55-4f34-af21-f6b56fda45b3 service nova] Enqueued Resource ID: 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 with Priority: HIGHEST for action port [ 886.787770] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 886.787911] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 886.788420] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 with Priority: HIGHEST for action port [ 886.788748] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.788868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.789201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.789201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.789286] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.790103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.790198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.790395] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.790494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.790557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.790717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.790788] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.868080] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.868244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.868398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.868539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.868674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.868825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.868923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.869182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.871081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.871081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.871081] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 886.900602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.900602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.900602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.900602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.900602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.910258] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 887.131327] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f59524d0-6c69-4693-8189-3ea92184056b: rpc.has_security_group_logging(os_id): False [ 887.154058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.155622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.155622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.155622] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 887.164878] env[65231]: INFO networking_nsxv3.common.synchronization [None req-34dcd68f-5a39-4559-9733-bd6c3aca40d3 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 887.165857] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 887.168638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.168638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.168638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.168638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.168638] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.203037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.203037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.203037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.203037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.203037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.203037] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 887.218283] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.218283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.218283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.218283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.218592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.239244] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 887.243114] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.244826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.244916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.245153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.245303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.254710] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 887.292740] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 with status ACTIVE [ 887.293304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.293906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.294287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.294418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.294509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.294668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.294751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.294957] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.295152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.295152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.295248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.295322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.295404] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5 is going to be updated. [ 887.297517] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.297517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.309349] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a5635d8b-6eb7-4564-b49b-ee5e1584f2bb tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 887.310257] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 887.310970] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.310970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.333257] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.333257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.333257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.333257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.333257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.333257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cbdebe-2d3c-4e7c-a8cc-6d574ee57eb5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.652588] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.652787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-315" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.652911] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-315" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.653346] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-315" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.653733] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.653847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.653882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.654111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.654238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.654441] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.654551] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.654824] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.654824] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.654928] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.654966] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.655079] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.677807] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.677807] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.677976] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.678058] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-315" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.678376] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.678554] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.678673] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.678999] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.679151] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60fad88f-c3f0-4b2b-946c-37d3e8d7c290',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.694825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.694957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.694995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.695765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.695864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.696242] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 already deleted. [ 887.696242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.696242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.696864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.696864] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.707488] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 887.707968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.823102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b in Status: SUCCESS [ 887.823416] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b deletion is rescheduled due to dependency. [ 887.823607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.182332] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.182630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.182630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.182882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.183071] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.183261] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 not found, creating... [ 888.183670] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.183951] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.184104] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.184450] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.184661] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.184973] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.185179] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.185301] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.185518] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.185661] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.185886] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 is going to be created. [ 888.210916] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.211489] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.211725] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.212213] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.213256] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.213713] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220412] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.220629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.221283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.221283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.221283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.221283] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 already deleted. [ 888.221638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.645205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86218e2b-505b-489d-9831-63e52af66c10 in Status: SUCCESS [ 888.645362] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86218e2b-505b-489d-9831-63e52af66c10 deletion is rescheduled due to dependency. [ 888.645576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86218e2b-505b-489d-9831-63e52af66c10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.921841] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 888.922220] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 deletion is rescheduled due to dependency. [ 888.922364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.922518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.922743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.922925] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.923104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.923173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.923326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.923421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.923518] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.965486] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-5df7234b-f4d1-4714-88ff-64c718880a9a service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 888.965486] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-5df7234b-f4d1-4714-88ff-64c718880a9a service nova] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 888.965835] env[65231]: INFO networking_nsxv3.common.synchronization [req-d8cfc3b7-86a0-4a94-89df-c5658252c932 req-5df7234b-f4d1-4714-88ff-64c718880a9a service nova] Enqueued Resource ID: 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 with Priority: HIGHEST for action port [ 888.966831] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_rules [ 888.966831] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 888.966831] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 with Priority: HIGHEST for action port [ 888.966831] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.966831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.966831] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.967150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.967150] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.967150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.967255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.967386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.967450] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60fad88f-c3f0-4b2b-946c-37d3e8d7c290',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.254644] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 889.254644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.254931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.255189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.255271] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.266375] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 889.266611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.427022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.473033] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 with status ACTIVE [ 889.473033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.473033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.473033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.473033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.473033] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60fad88f-c3f0-4b2b-946c-37d3e8d7c290 is going to be updated. [ 889.496621] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.496772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.496845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.497078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.497223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.497379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60fad88f-c3f0-4b2b-946c-37d3e8d7c290" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.758313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.758460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.758531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.758740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.758903] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.759014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.759099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.759233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.759321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.759407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.759496] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.801057] env[65231]: INFO networking_nsxv3.common.synchronization [req-e3986ba8-99b3-4045-801d-0db34bb7a760 req-9b89fe88-b142-465f-9d56-5cdcdafb7470 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 889.801057] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 889.801057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.801057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.801271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.801299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.801496] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.802123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.802123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.802320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.802430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.802530] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.930173] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.174821] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.176029] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.176322] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.176740] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.177147] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.177427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.177576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.177899] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.178127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.178442] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.178619] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.178783] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.178953] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.179143] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.179330] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.179518] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.202050] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.202050] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.202050] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.202050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.202050] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-428763be-11e1-4296-8bf7-b4bef6bd414f taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.202050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.202050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.202050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.202050] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428763be-11e1-4296-8bf7-b4bef6bd414f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.261502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.261786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.261786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.261879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.262183] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.262304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.262375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.262553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.262658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.262764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.262931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.263062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.263134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.263303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.263465] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.263573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.263636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.263796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.263880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.263963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.264089] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.308124] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.434283] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.434485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.434557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.434822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.434938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.434979] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 890.482757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.482757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.482757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.482757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.482757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.491953] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 890.708031] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.708031] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 428763be-11e1-4296-8bf7-b4bef6bd414f not found, creating... [ 890.708031] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.708031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.708644] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.708644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.708644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.708644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.710161] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.710701] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 428763be-11e1-4296-8bf7-b4bef6bd414f is going to be created. [ 890.749025] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.749025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.749025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.749025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.749025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.749025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.768439] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f59524d0-6c69-4693-8189-3ea92184056b: rpc.has_security_group_logging(os_id): False [ 890.791873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.792167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.792307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.792550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.792645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.792891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.793012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.793197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.793421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.793509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.795113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.795113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.795113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.795113] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 890.812939] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.887426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.887632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.887708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.887950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.888154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.903022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 891.315629] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.315965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.315965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.316443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.316443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.316443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 891.351216] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.351359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.351428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.351645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.351811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.370308] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 891.553996] env[65231]: INFO networking_nsxv3.common.synchronization [req-e3986ba8-99b3-4045-801d-0db34bb7a760 req-e748f628-d715-4bae-ae47-5ec9239d1b5e service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 891.554215] env[65231]: INFO networking_nsxv3.common.synchronization [req-e3986ba8-99b3-4045-801d-0db34bb7a760 req-e748f628-d715-4bae-ae47-5ec9239d1b5e service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 891.554413] env[65231]: INFO networking_nsxv3.common.synchronization [req-e3986ba8-99b3-4045-801d-0db34bb7a760 req-e748f628-d715-4bae-ae47-5ec9239d1b5e service nova] Enqueued Resource ID: 428763be-11e1-4296-8bf7-b4bef6bd414f with Priority: HIGHEST for action port [ 891.555065] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 891.555223] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 891.555299] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428763be-11e1-4296-8bf7-b4bef6bd414f with Priority: HIGHEST for action port [ 891.555586] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.555727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.555770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.555966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.556063] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.557072] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.557204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.557522] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-428763be-11e1-4296-8bf7-b4bef6bd414f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.558250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.558368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.558660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.558795] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428763be-11e1-4296-8bf7-b4bef6bd414f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.904281] env[65231]: INFO networking_nsxv3.common.synchronization [req-db4f64be-1e44-4661-a0fe-33ccf642416c req-2d0e518a-77e3-46bb-8714-be47c747b8c6 tempest-ServersTestJSON-1140929688 tempest-ServersTestJSON-1140929688-project-member] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 891.907464] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGHEST for action security_group_members [ 891.907464] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.907464] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.907464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.907464] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.064179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064179] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 428763be-11e1-4296-8bf7-b4bef6bd414f with status ACTIVE [ 892.064179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.064179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.064671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.064671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064671] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 428763be-11e1-4296-8bf7-b4bef6bd414f is going to be updated. [ 892.092411] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.092590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.092693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.093373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.093532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.093714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-428763be-11e1-4296-8bf7-b4bef6bd414f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.187939] env[65231]: INFO networking_nsxv3.common.synchronization [None req-1f09f9f4-cbae-4ba1-84c7-e5b950adeb33 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 892.188437] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 892.188836] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.189039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.189143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.189505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.189649] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.396842] env[65231]: INFO networking_nsxv3.common.synchronization [None req-70b2a3f0-9cce-49d4-9a3c-7da47a2c5ef8 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 892.397192] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 892.397534] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.397640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.409929] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.410201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.410254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.410426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.410520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.410723] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.410831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.410880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.411035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.411117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.411218] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 is going to be updated. [ 892.443890] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.443890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.443890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.443890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.444134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.454160] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: IN_PROGRESS for 2s [ 892.506735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 892.506971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.507456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.507456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.507601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.507678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.507722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.507856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.507935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.508032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.508381] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.510750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.510961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.511149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.511279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.511344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.511823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.511954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.511954] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.513603] env[65231]: INFO networking_nsxv3.common.synchronization [req-0ab8c224-4ae7-4384-af21-8706cd36336d req-fbfaaf41-d41b-4fb2-b8a9-319fb6cc0e0b tempest-ServerAddressesNegativeTestJSON-666533324 tempest-ServerAddressesNegativeTestJSON-666533324-project-member] Enqueued Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 892.516466] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 892.516798] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.516911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.516981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.517230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.517389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.517491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.517557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.517705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.517797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.517881] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.730028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.730028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 already deleted. [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.730028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.730028] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.873175] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.873175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-295" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.873175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-295" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.873175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-295" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.873175] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.873175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.873803] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.874193] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.874478] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.874825] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.875188] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.875434] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.877734] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.877734] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.877734] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.877734] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.899593] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.899811] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.900017] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.900259] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-295" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.900676] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.900899] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.901075] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.901634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.901683] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.921665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 892.921792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.014789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.015028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.015113] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.019953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.020140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.020215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.020440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.020525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.020808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.020808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.021066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.021066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.021132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.021168] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 already deleted. [ 893.021613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.253168] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.253168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.253168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.253168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.253168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.253168] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 already deleted. [ 893.253168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.381206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 893.381303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.381477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.381687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.381870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.381979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.382076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.382234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.382310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.382403] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.406862] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.407281] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.411092] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a not found, creating... [ 893.411092] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.411092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.411092] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.411475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.411475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.411475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.411475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.411475] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a is going to be created. [ 893.440031] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.440031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.440031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.440317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.441212] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.441496] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.518241] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.672701] env[65231]: INFO networking_nsxv3.common.synchronization [req-f66e7d72-73db-46e1-a2f2-59f45b38b002 req-47f996a3-258a-4ac2-ac46-967964004b40 tempest-MigrationsAdminTest-1128041665 tempest-MigrationsAdminTest-1128041665-project-member] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 893.673370] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGHEST for action security_group_members [ 893.675091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.675091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.675091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.675091] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.885903] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.003936] env[65231]: INFO networking_nsxv3.common.synchronization [req-e3e0ad08-104c-492d-a26a-e80e22fc405e req-047b53a9-9600-4070-aed1-812aa98cefe0 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 894.004250] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 894.004587] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.004711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.004779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.005184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.005377] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.005548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.005548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.006490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.006490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.006490] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.022327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.022506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.022506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.022777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.022869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.023017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 894.060334] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.060513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.060555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.061199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.061199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.072976] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 894.162812] env[65231]: INFO networking_nsxv3.common.synchronization [req-0ab8c224-4ae7-4384-af21-8706cd36336d req-f25710f5-1a71-48d3-a981-eb9271a7b224 service nova] Enqueued Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_rules [ 894.163033] env[65231]: INFO networking_nsxv3.common.synchronization [req-0ab8c224-4ae7-4384-af21-8706cd36336d req-f25710f5-1a71-48d3-a981-eb9271a7b224 service nova] Enqueued Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 894.163197] env[65231]: INFO networking_nsxv3.common.synchronization [req-0ab8c224-4ae7-4384-af21-8706cd36336d req-f25710f5-1a71-48d3-a981-eb9271a7b224 service nova] Enqueued Resource ID: d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a with Priority: HIGHEST for action port [ 894.163754] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_rules [ 894.163943] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 894.163993] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a with Priority: HIGHEST for action port [ 894.164461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.164598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.164693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.168023] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.168023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.168023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.168023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.171066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.173171] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.173171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.173171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.173171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.173171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.173171] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.179261] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.179438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.179485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.179682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.222324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.222324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.222324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.222324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.222324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.222324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.222324] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be updated. [ 894.250447] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.250621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.250661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.250872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.251284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.261588] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: IN_PROGRESS for 2s [ 894.388203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.467786] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 in Status: SUCCESS [ 894.468772] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 deletion is rescheduled due to dependency. [ 894.468772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.509424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.509702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.509821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.510193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.510320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.510594] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.510763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.510896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.511098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.511249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.511384] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 894.543240] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.543395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.543475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.543695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.543880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.555449] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 894.675774] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.675945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.676677] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a with status ACTIVE [ 894.676677] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.676677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.676677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.676677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.676991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.676991] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.676991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.677199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.677199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.677329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.677920] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.677920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.677920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.677920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.677920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.677920] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a is going to be updated. [ 894.682914] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.718365] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.718365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.718365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.719334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.719334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.719334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0c79de8-0e88-4cb4-91ca-03d0aadb6d1a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892190] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.892342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.892730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.892730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 894.923651] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.923795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.923875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.924109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.924247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.934689] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 895.187462] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.690753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.691211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.691211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.691317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.691363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.691490] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 is going to be created. [ 895.760582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.761712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.761806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.762065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.762220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.775664] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: UNINITIALIZED for 2s [ 896.087266] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 896.087266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.087590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.087910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.088249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.088396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.088510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.088754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.088891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.092633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.092922] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.093176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.093316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.093862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.094420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.094886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.094886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.095629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.096386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.096774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.097062] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.278620] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 in Status: SUCCESS [ 896.278620] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 deletion is rescheduled due to dependency. [ 896.278620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.566344] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 896.566524] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 deletion is rescheduled due to dependency. [ 896.566632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.601156] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4930f591-dad9-4803-8936-7b21d9dabe55: rpc.has_security_group_logging(os_id): False [ 896.622753] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.622953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.623011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.623252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.623347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.623568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.623673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.623737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.623885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.623961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.624154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.624252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.624305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.624457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.624527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.624712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.624807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.624866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.625014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.629308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.629561] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 896.747427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.747747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.747747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.747862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.748016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.783375] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 896.944131] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 896.944357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.944525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.944834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.944932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.945063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.945132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.945348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.945434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.945522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.945612] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.448366] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.448536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.448588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.448809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.448979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.449093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.449404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.449404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.449404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.449606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.449646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.449743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.449796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.449939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.450091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.450565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.450653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.450859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.451657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.451657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.451657] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.788060] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: SUCCESS [ 897.788430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.788564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.788681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.788873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.789066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.789066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.789338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.789433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.789521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.789611] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.954229] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 897.974316] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.974538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.974599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.974780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.974885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.975101] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.975205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.975283] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.975399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.975794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.975794] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.975794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.976022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.976022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.976082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.976316] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.976428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.976493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.976619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.976700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.976835] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 898.076758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.076758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.076758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.076758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.076758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.090504] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 898.293530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.293651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.293651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.293834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.293989] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.294105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.294168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.294320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.294408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.294512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.294638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.294729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.294759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.294897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.295041] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.295150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.295235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.296278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.296278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.296278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.296278] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.799013] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66588024-bc1b-4c51-8e2d-4b20cabf9055: rpc.has_security_group_logging(os_id): False [ 898.811305] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 898.811645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.811906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.812238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.812356] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.829176] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.829331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.829393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.829628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.829720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.829918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.830051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.830135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.830284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.831636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.831636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.831636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.831636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 is going to be created. [ 898.914787] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.914999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.914999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.915242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.915431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.934690] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: IN_PROGRESS for 2s [ 899.165796] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.166289] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 899.319824] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.319824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.319824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.319824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.320399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.320399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.320399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.320399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.320399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.320399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.320664] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.823526] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.823996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.824184] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.824597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.824702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.824885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.824976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.825081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.825260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.825389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.825456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.825650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.825900] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.825964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.826089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.826314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.826399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.826490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.826578] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.106169] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 900.106475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.319521] env[65231]: INFO networking_nsxv3.common.synchronization [req-e92e9220-3c97-42ee-9c57-cdcb3e604aa2 req-41136ee3-15e3-4a34-b549-cfa7d3c16bc9 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 900.320157] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 900.320491] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.320665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.320665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.320927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.321596] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.321727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.321788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.321958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.322059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.322188] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.328604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4930f591-dad9-4803-8936-7b21d9dabe55: rpc.has_security_group_logging(os_id): False [ 900.354326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.354516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.354607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.354908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.355069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.355402] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.355573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.355686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.355937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.356074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.356509] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.356695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.356797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.357042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.357176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.357472] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.357619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.357714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.357932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.358076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.358218] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 900.454050] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.454050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.454050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.454050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.454050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.475364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 900.824476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.824901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.824901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.825021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.825385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.825682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.825796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.825998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.826179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.826738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.826738] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be deleted. [ 900.845287] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.847238] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.847238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.847238] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.847238] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.847944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.847944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.847944] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.847944] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.847944] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.865153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.865312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.865350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.866641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.866641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.866641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.867534] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.867682] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.867812] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.867967] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.868320] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-62d32117-a4c2-4340-b3f8-6b5804c382c4 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.868479] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.868593] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.868875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.870637] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d32117-a4c2-4340-b3f8-6b5804c382c4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.953615] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: SUCCESS [ 900.953853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.017039] env[65231]: INFO networking_nsxv3.common.synchronization [req-31c59324-24b2-4cfd-9271-02e71083f9e6 req-884e9de7-ec24-45bb-8b86-6ff6f7cc3921 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 901.017606] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 901.017919] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.018054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.018123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.018379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.018553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.018628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.018682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.018825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.018909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.019069] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.305182] env[65231]: INFO networking_nsxv3.common.synchronization [None req-cc8eaf4e-e7e1-485b-a347-75680fbb48e2 None None] Enqueued Resource ID: 40974978-f4ad-46be-a970-b007eb7acb6f with Priority: HIGHEST for action port [ 901.305447] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40974978-f4ad-46be-a970-b007eb7acb6f with Priority: HIGHEST for action port [ 901.306865] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-40974978-f4ad-46be-a970-b007eb7acb6f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.306865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40974978-f4ad-46be-a970-b007eb7acb6f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.306865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40974978-f4ad-46be-a970-b007eb7acb6f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.307420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40974978-f4ad-46be-a970-b007eb7acb6f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.307420] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40974978-f4ad-46be-a970-b007eb7acb6f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.370995] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.371306] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.371440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.371716] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.371867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.372069] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 62d32117-a4c2-4340-b3f8-6b5804c382c4 not found, creating... [ 901.372344] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.372509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.372625] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.372872] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.372980] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.373280] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.373434] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.373549] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.373752] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.373882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.374227] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 62d32117-a4c2-4340-b3f8-6b5804c382c4 is going to be created. [ 901.393610] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.394021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.394255] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.394705] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.394938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.395343] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.521311] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.521482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.521552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.521768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.521861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.522142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.522251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.522314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.522474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.522553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.522673] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 already deleted. [ 901.522710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.809206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40974978-f4ad-46be-a970-b007eb7acb6f [ 901.809453] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.811017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.811017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.811017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.811017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.811017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40974978-f4ad-46be-a970-b007eb7acb6f already deleted. [ 901.811017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40974978-f4ad-46be-a970-b007eb7acb6f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.134709] env[65231]: INFO networking_nsxv3.common.synchronization [req-e92e9220-3c97-42ee-9c57-cdcb3e604aa2 req-a3b9e8a3-04fa-47f4-acaf-919462137f82 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 902.134905] env[65231]: INFO networking_nsxv3.common.synchronization [req-e92e9220-3c97-42ee-9c57-cdcb3e604aa2 req-a3b9e8a3-04fa-47f4-acaf-919462137f82 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 902.135044] env[65231]: INFO networking_nsxv3.common.synchronization [req-e92e9220-3c97-42ee-9c57-cdcb3e604aa2 req-a3b9e8a3-04fa-47f4-acaf-919462137f82 service nova] Enqueued Resource ID: 62d32117-a4c2-4340-b3f8-6b5804c382c4 with Priority: HIGHEST for action port [ 902.135613] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 902.135742] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 902.135845] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d32117-a4c2-4340-b3f8-6b5804c382c4 with Priority: HIGHEST for action port [ 902.136366] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.136366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.136366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.136578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.136578] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.137929] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.138066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.138126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.138290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.138492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.138561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.138640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.138713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.138925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.138925] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.142745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-62d32117-a4c2-4340-b3f8-6b5804c382c4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.142745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.142745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.142745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.142745] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d32117-a4c2-4340-b3f8-6b5804c382c4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.436362] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.436964] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.436964] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.436964] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.439789] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.439789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.439789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.439789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.439789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.439789] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.439789] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.439789] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.439789] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.439789] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.439789] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.439789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.450447] env[65231]: INFO networking_nsxv3.common.synchronization [req-6f3da305-71d3-4c20-b65d-d3eb49164f0b req-e23dea7e-ca5d-42ab-b76d-6a2e3a61ef21 tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 902.450999] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 902.451327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.451496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.451537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.451703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.451854] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.451953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.452201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.452201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.452281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.452374] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.461866] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.462176] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.462176] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.462176] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.462854] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-f575f483-44e8-4dc1-99e0-2a0590318297 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.462967] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.463493] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.463705] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f575f483-44e8-4dc1-99e0-2a0590318297',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.498032] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 902.498256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.642887] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.645105] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62d32117-a4c2-4340-b3f8-6b5804c382c4 with status ACTIVE [ 902.645105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.645105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.645105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.645105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.645831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.646063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.646374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.646618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.646812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62d32117-a4c2-4340-b3f8-6b5804c382c4 is going to be updated. [ 902.649426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.649426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.673239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.673239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.673239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.673239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.673239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.673239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62d32117-a4c2-4340-b3f8-6b5804c382c4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.954335] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.966332] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.966861] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.966861] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.967317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.967317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.968025] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port f575f483-44e8-4dc1-99e0-2a0590318297 not found, creating... [ 902.968025] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.968025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.968025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.971327] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.971327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.971327] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: f575f483-44e8-4dc1-99e0-2a0590318297 is going to be created. [ 902.995427] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.995613] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.995782] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.997336] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.997336] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.997336] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.085817] env[65231]: INFO networking_nsxv3.common.synchronization [req-418c5356-60c3-4b87-8dde-505378421a8f req-2b0d56c7-acaf-467c-bb4f-4b866a327000 tempest-ServerMetadataTestJSON-1058112602 tempest-ServerMetadataTestJSON-1058112602-project-member] Enqueued Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 903.086399] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 903.086770] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.086893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.086935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.087196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.087355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.087465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.087542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.087879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.087879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.087985] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.150263] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.457262] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.590506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.591458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.591584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.591791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.591989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.592161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.592828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.592828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.592828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.592828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.592828] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 already deleted. [ 903.592828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.601220] env[65231]: INFO networking_nsxv3.common.synchronization [None req-26efeac2-fd72-4c0f-af0b-7073a8c1e9f0 None None] Enqueued Resource ID: dce908f0-a08c-407c-a52c-67b17ec71ca9 with Priority: HIGHEST for action port [ 903.602365] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce908f0-a08c-407c-a52c-67b17ec71ca9 with Priority: HIGHEST for action port [ 903.603545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-dce908f0-a08c-407c-a52c-67b17ec71ca9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.603942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dce908f0-a08c-407c-a52c-67b17ec71ca9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.606023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dce908f0-a08c-407c-a52c-67b17ec71ca9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.606023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dce908f0-a08c-407c-a52c-67b17ec71ca9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.606023] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dce908f0-a08c-407c-a52c-67b17ec71ca9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.652843] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.653057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.653057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.653317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.653415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.653535] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 903.695326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.695326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.695326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.695757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.696010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.708882] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: UNINITIALIZED for 2s [ 903.761687] env[65231]: INFO networking_nsxv3.common.synchronization [req-31c59324-24b2-4cfd-9271-02e71083f9e6 req-8669dc20-c708-4cbe-a9d2-6fa33fa46846 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 903.761687] env[65231]: INFO networking_nsxv3.common.synchronization [req-31c59324-24b2-4cfd-9271-02e71083f9e6 req-8669dc20-c708-4cbe-a9d2-6fa33fa46846 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 903.761687] env[65231]: INFO networking_nsxv3.common.synchronization [req-31c59324-24b2-4cfd-9271-02e71083f9e6 req-8669dc20-c708-4cbe-a9d2-6fa33fa46846 service nova] Enqueued Resource ID: f575f483-44e8-4dc1-99e0-2a0590318297 with Priority: HIGHEST for action port [ 903.762473] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 903.762540] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 903.762661] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f575f483-44e8-4dc1-99e0-2a0590318297 with Priority: HIGHEST for action port [ 903.762935] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.763101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.763584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.763584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.763682] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.765636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.766208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.766208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.766208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.766356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.766562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.766562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.766952] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.768251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f575f483-44e8-4dc1-99e0-2a0590318297 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.768390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.768457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.768626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.768710] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f575f483-44e8-4dc1-99e0-2a0590318297',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.801221] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.801427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-136" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.801510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-136" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.801854] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-136" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.803062] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.803062] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.803062] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.803062] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.803429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.803650] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.803761] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.803865] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.803972] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.804105] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.804217] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.804352] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.865511] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.865782] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.061 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.865998] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.866314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-136" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.866801] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.867080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.867282] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.867755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.867960] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.960048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.960496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.960496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.960738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.960738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.960738] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 903.992141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.992328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.992402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.992628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.992832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.002828] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 904.108686] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dce908f0-a08c-407c-a52c-67b17ec71ca9 [ 904.108686] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.108686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.108686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.108883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.108883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.108996] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dce908f0-a08c-407c-a52c-67b17ec71ca9 already deleted. [ 904.109093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dce908f0-a08c-407c-a52c-67b17ec71ca9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.272242] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.273144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.273262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.273480] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f575f483-44e8-4dc1-99e0-2a0590318297 with status ACTIVE [ 904.273625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.273754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.273854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.274028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.274120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.274327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.274509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.274509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.274673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.274756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.274966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.275098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.275134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.275263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.275364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.275426] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f575f483-44e8-4dc1-99e0-2a0590318297 is going to be updated. [ 904.304395] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.304395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.304516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.304727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.304882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.305080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f575f483-44e8-4dc1-99e0-2a0590318297" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.370915] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.371148] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.371277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.371550] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.371697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.371849] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b not found, creating... [ 904.372208] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.372378] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.372491] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.372711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.372846] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.373238] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.373550] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.373691] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.373906] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.374049] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.374190] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b is going to be created. [ 904.411640] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.411860] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.411984] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.412369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.412647] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.412891] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.778282] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.099999] env[65231]: INFO networking_nsxv3.common.synchronization [req-418c5356-60c3-4b87-8dde-505378421a8f req-a55aa69c-ef60-4ce4-be28-5125e822144a service nova] Enqueued Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_rules [ 905.100327] env[65231]: INFO networking_nsxv3.common.synchronization [req-418c5356-60c3-4b87-8dde-505378421a8f req-a55aa69c-ef60-4ce4-be28-5125e822144a service nova] Enqueued Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 905.100933] env[65231]: INFO networking_nsxv3.common.synchronization [req-418c5356-60c3-4b87-8dde-505378421a8f req-a55aa69c-ef60-4ce4-be28-5125e822144a service nova] Enqueued Resource ID: 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b with Priority: HIGHEST for action port [ 905.101838] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_rules [ 905.102139] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 905.102624] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b with Priority: HIGHEST for action port [ 905.102872] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.105805] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.105805] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.105805] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.105805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.105805] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.108571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.108571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.108571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.108571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.108571] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.281474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.281474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.282017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.282017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.282017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.282222] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be created. [ 905.309775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.309977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.310220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.310346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.310512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.326107] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: UNINITIALIZED for 2s [ 905.415431] env[65231]: INFO networking_nsxv3.common.synchronization [req-0d7bcb17-d2f0-47a3-b7d7-8bd5d78248cc req-d1239fb3-aada-4006-b903-8e78f96a71dd tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 905.415967] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 905.416308] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.416440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.416509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.417372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.417372] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.417372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.417372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.417372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.417372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.417372] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.440192] env[65231]: INFO networking_nsxv3.common.synchronization [None req-57ce048f-b36c-42f5-9bca-ee82e960a92d None None] Enqueued Resource ID: be541f43-bb79-41af-b88b-862f467985c8 with Priority: HIGHEST for action port [ 905.441452] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be541f43-bb79-41af-b88b-862f467985c8 with Priority: HIGHEST for action port [ 905.442784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-be541f43-bb79-41af-b88b-862f467985c8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.442884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be541f43-bb79-41af-b88b-862f467985c8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.442995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be541f43-bb79-41af-b88b-862f467985c8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.443215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be541f43-bb79-41af-b88b-862f467985c8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.443307] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be541f43-bb79-41af-b88b-862f467985c8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.610858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.611044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.613162] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.613439] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b with status ACTIVE [ 905.613634] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.613786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.613855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.614057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.614141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.614318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.614411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.614470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.614614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.614708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.614891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.614980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.615070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.615218] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.615464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.615464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b is going to be updated. [ 905.649141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.649278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.649278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.650799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.650799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.650799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5449dc3d-ea6a-47a3-a7ed-9c4f79b2036b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.721503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.721503] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.721503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.721926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.721926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.721926] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.771209] env[65231]: INFO networking_nsxv3.common.synchronization [req-0d7bcb17-d2f0-47a3-b7d7-8bd5d78248cc req-9a79dbbb-18b6-439f-acb7-aa0261b025ec tempest-ServersTestMultiNic-87201456 tempest-ServersTestMultiNic-87201456-project-member] Enqueued Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 905.771837] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4930f591-dad9-4803-8936-7b21d9dabe55 with Priority: HIGHEST for action security_group_members [ 905.772296] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-4930f591-dad9-4803-8936-7b21d9dabe55 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.772476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.919310] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.946389] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be541f43-bb79-41af-b88b-862f467985c8 [ 905.946747] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.946901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.946977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.947528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.947528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.947528] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be541f43-bb79-41af-b88b-862f467985c8 already deleted. [ 905.947528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be541f43-bb79-41af-b88b-862f467985c8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.013785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 906.014110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.120240] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.172600] env[65231]: INFO networking_nsxv3.common.synchronization [req-492567e9-444e-4dc5-b38f-cc0b210169a0 req-e927009a-e578-4873-8365-bfa1ed6cd453 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 906.173491] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 906.174197] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.174439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.174496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.174745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.174905] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.175051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.175103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.175220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.175394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.175394] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.226341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.226341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.226341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.226341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.226341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.227022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.227022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.227022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.227022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.227022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.422922] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.561395] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.561600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.561719] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.561986] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.562289] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.562451] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.563311] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.563698] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.563769] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.563951] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.564082] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.564193] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.564298] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.564420] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.564552] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.564844] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.584106] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.584265] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.584387] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.584623] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.584948] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.585145] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.585267] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.585614] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.585758] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e24dd6d-ae9f-4932-a570-c78eb4bc3126',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.623521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.623717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.623779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.624044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.624044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.624200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 is going to be created. [ 906.652562] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.652562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.652562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.652780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.652893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.664087] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: UNINITIALIZED for 2s [ 906.678212] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.678363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.678767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.679076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.679226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.679399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.679502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.679556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.679709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.679788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.679887] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 already deleted. [ 906.679972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.730134] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f698486-5433-4f5d-838f-8989284e2ed7: rpc.has_security_group_logging(os_id): False [ 906.770350] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.770571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.770646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.770910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.771044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.771237] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.771346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.771413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.771592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.771720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.771946] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.772054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.772154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.772316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.772449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.772720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.772816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.772884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.773153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.773153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.773621] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 906.838145] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.838145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.838145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.838145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.838145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.850341] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 906.926582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.926817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.926817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.927036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.927126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.927228] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 906.963748] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.963950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.964026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.964365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.964580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.974347] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 907.089051] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.089313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.089547] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.089957] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.090234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.090433] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 not found, creating... [ 907.090750] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.090868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.090953] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.091366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.091431] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.092053] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.092053] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.092053] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.092343] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.092481] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.092619] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 is going to be created. [ 907.117504] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.117724] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.117878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.118148] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.118375] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.118645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.338797] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 907.339138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.339309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.339578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.339831] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.340032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.340184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.340260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.340353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.340406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.340483] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.515117] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c917a9da-0158-4e4d-9e6c-fd3b6be8795b None None] Enqueued Resource ID: 5329acd5-880e-48f8-8183-6770b2c42e27 with Priority: HIGHEST for action port [ 907.515652] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5329acd5-880e-48f8-8183-6770b2c42e27 with Priority: HIGHEST for action port [ 907.516024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5329acd5-880e-48f8-8183-6770b2c42e27 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.516690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5329acd5-880e-48f8-8183-6770b2c42e27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.516690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5329acd5-880e-48f8-8183-6770b2c42e27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.516690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5329acd5-880e-48f8-8183-6770b2c42e27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.516690] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5329acd5-880e-48f8-8183-6770b2c42e27',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.823646] env[65231]: INFO networking_nsxv3.common.synchronization [req-492567e9-444e-4dc5-b38f-cc0b210169a0 req-8b217f3f-1f33-42dd-aaf4-15711c0b8260 service nova] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 907.823849] env[65231]: INFO networking_nsxv3.common.synchronization [req-492567e9-444e-4dc5-b38f-cc0b210169a0 req-8b217f3f-1f33-42dd-aaf4-15711c0b8260 service nova] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 907.823983] env[65231]: INFO networking_nsxv3.common.synchronization [req-492567e9-444e-4dc5-b38f-cc0b210169a0 req-8b217f3f-1f33-42dd-aaf4-15711c0b8260 service nova] Enqueued Resource ID: 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 with Priority: HIGHEST for action port [ 907.824516] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_rules [ 907.824650] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 907.824743] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 with Priority: HIGHEST for action port [ 907.825661] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.825661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.825661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.825909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.825909] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.826960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.827129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.827290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.827482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.827683] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.828109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.828192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.832028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.832028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.832028] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.832028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.832028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.832028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.832028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.832028] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e24dd6d-ae9f-4932-a570-c78eb4bc3126',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.845378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.845526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.845599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.845801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.845971] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.846081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.846147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.846292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.846378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.846465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.846608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.846700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.846759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.846899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.847044] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.847136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.847197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.847329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.847418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.847498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.847588] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.019376] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5329acd5-880e-48f8-8183-6770b2c42e27 [ 908.019801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.019940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.020056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.020289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.020383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.020484] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5329acd5-880e-48f8-8183-6770b2c42e27 already deleted. [ 908.020568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5329acd5-880e-48f8-8183-6770b2c42e27" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.149772] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a6d30f4e-8c01-4c6d-a604-285d6aaa992c tempest-ServerActionsV293TestJSON-645260172 tempest-ServerActionsV293TestJSON-645260172-project-member] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 908.150420] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 908.150667] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.150841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.150841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.151108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.151191] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.257061] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e24cfa64-1d2c-4ef2-9a82-dc710e00e5d0 tempest-ServerActionsV293TestJSON-645260172 tempest-ServerActionsV293TestJSON-645260172-project-member] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 908.257061] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 908.257571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.257675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.332425] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.334019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.334019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.334019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 with status ACTIVE [ 908.334019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.334265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.334265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.334397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.334481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.334658] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.334751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.334811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.334960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.335043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.335219] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.335433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.335433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.335562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.335562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.335649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e24dd6d-ae9f-4932-a570-c78eb4bc3126 is going to be updated. [ 908.353312] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d80f7f-757f-4f15-9618-2e66c9f29176: rpc.has_security_group_logging(os_id): False [ 908.364782] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.364979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.365109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.365356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.365983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.365983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e24dd6d-ae9f-4932-a570-c78eb4bc3126" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.374568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.374568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.374568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.374568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.375107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.375107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.375261] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.375434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.376027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.376027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.376027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.376027] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be created. [ 908.437870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.438182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.438329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.438660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.438946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.450997] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 908.678458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: SUCCESS [ 908.678877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.678877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.679138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.679379] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.679545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.679694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.679939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.680143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.680299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.680614] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.682984] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.682984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.683241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.683693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.683693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.683693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 already deleted. [ 908.683693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.684264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.684264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.684264] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.838833] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.868228] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 908.868709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.986692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 908.986993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.988146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.988336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.988923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.988923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.989122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.990392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.990392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.990392] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4930f591-dad9-4803-8936-7b21d9dabe55',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.186968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.186968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.186968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.187608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.187608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.187608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.187608] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.187608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.187608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.187787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.187787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.187787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.187863] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.214904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.214904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.214904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.215970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.215970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.215970] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 already deleted. [ 909.215970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.342625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.342625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.342625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.342865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.342991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.343083] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 is going to be created. [ 909.370913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.370913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.370913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.371151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.371354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.381789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: UNINITIALIZED for 2s [ 909.495111] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.495111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.495111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.495111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.495111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.495474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.495474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.495474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.495474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.495604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.495604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 is going to be updated. [ 909.529785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.529918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.529985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.530234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.530373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.543122] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: IN_PROGRESS for 2s [ 909.693507] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66402614-4b09-43ce-b9ff-d784c9639b26: rpc.has_security_group_logging(os_id): False [ 909.745681] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.745681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.745681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.745949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.745949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.746056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.746124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.746171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.747817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.747817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.747817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.747817] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 is going to be created. [ 909.876327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.876508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.876578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.877107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.877275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.898215] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: IN_PROGRESS for 2s [ 910.478723] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 910.479119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.394039] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: SUCCESS [ 911.394039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.394397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.394397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.394601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.394727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.394798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.394968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.395064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.395166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.395258] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.461313] env[65231]: INFO networking_nsxv3.common.synchronization [req-751ce36c-9e5a-4775-935e-4873af0d676f req-e1692487-758d-4ad3-83c8-83b622e16468 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 911.461822] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 911.462187] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.462327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.463140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.464062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.464062] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.464062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.464062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.464062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.464473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.464473] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.556312] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4930f591-dad9-4803-8936-7b21d9dabe55 in Status: SUCCESS [ 911.556516] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4930f591-dad9-4803-8936-7b21d9dabe55 deletion is rescheduled due to dependency. [ 911.556659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4930f591-dad9-4803-8936-7b21d9dabe55" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.898265] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.912923] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: SUCCESS [ 911.913392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.968376] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.035955] env[65231]: INFO networking_nsxv3.common.synchronization [None req-7491205a-dd0f-40c2-ab23-7432999a5d4d tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 912.035955] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 912.036360] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.036562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.036633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.036868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.037099] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.037180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.037216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.037361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.037450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.037539] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.404297] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a77ea6c-8279-4404-bdc2-a6401a557a16: rpc.has_security_group_logging(os_id): False [ 912.428635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.428825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.428877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.429149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.429293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.429581] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.429690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.429756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.429991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.430798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.430913] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 is going to be created. [ 912.473511] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.512098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.512363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.512363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.512550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.512729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.527556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: IN_PROGRESS for 2s [ 912.541123] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.716945] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a218f691-83e7-41f4-a44e-c01c9d6756b5 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 with Priority: HIGHEST for action security_group_rules [ 912.717725] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 with Priority: HIGHEST for action security_group_rules [ 912.718495] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755ee775-2e46-4ab9-ad00-59cafaff71e4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.718644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.719154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.719443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.719443] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755ee775-2e46-4ab9-ad00-59cafaff71e4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.825026] env[65231]: INFO networking_nsxv3.common.synchronization [None req-25f9ae92-cb48-4a32-81ab-f5c235db7bd7 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 with Priority: HIGHEST for action security_group_rules [ 912.825026] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 with Priority: HIGHEST for action security_group_rules [ 912.825026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-755ee775-2e46-4ab9-ad00-59cafaff71e4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.825394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.979589] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.979803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.979918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.982656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.982656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.982656] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 913.026953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.027184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.027337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.028039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.028039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.045130] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.056549] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 913.245524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.245761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.245761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.245905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.245960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.246060] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 already deleted. [ 913.246137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.246318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.246514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.246599] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('755ee775-2e46-4ab9-ad00-59cafaff71e4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.549355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.549355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.549355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.549355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.549355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.549355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 913.583198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.583415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.583487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.583881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.584049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.587053] env[65231]: INFO networking_nsxv3.common.synchronization [req-d88a9657-c458-4de9-bac5-433be4b6d246 req-e8698743-0b7a-44e7-98c6-5f2dd1994d65 tempest-ServerAddressesNegativeTestJSON-666533324 tempest-ServerAddressesNegativeTestJSON-666533324-project-member] Enqueued Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 913.587576] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 with Priority: HIGHEST for action security_group_members [ 913.587882] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66588024-bc1b-4c51-8e2d-4b20cabf9055 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.588016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.588095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.588297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.588457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.588560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.588639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.588791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.588880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.588977] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66588024-bc1b-4c51-8e2d-4b20cabf9055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.595310] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 913.778823] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.779009] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.779051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.779280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.779415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.779702] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 755ee775-2e46-4ab9-ad00-59cafaff71e4 already deleted. [ 913.779966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-755ee775-2e46-4ab9-ad00-59cafaff71e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.090842] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.091162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.091162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.091357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.091466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.091722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.091824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.091880] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.092068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.092188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.092272] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 is going to be updated. [ 914.127580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.127772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.127856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.128181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.128371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.143327] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: IN_PROGRESS for 2s [ 914.542490] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: SUCCESS [ 914.542788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.726882] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.727256] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.727256] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.727515] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.727779] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.729266] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.729413] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.729683] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.729836] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.730071] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.730187] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.730296] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.730401] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.730509] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.730616] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.730754] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.773971] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.774180] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.774300] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.774504] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.774883] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-348ccaf4-b040-4233-ae8c-a0ec7cbea147 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.775049] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.775168] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.775541] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.775707] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348ccaf4-b040-4233-ae8c-a0ec7cbea147',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.067889] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 915.068083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.120530] env[65231]: INFO networking_nsxv3.common.synchronization [None req-fa31a963-b4c9-48bb-99f0-3c92ae14f4c8 None None] Enqueued Resource ID: f6f8f30d-5731-40e5-bb35-7b1cec54b92a with Priority: HIGHEST for action port [ 915.120530] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f8f30d-5731-40e5-bb35-7b1cec54b92a with Priority: HIGHEST for action port [ 915.120530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f8f30d-5731-40e5-bb35-7b1cec54b92a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.120530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f8f30d-5731-40e5-bb35-7b1cec54b92a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.120530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f8f30d-5731-40e5-bb35-7b1cec54b92a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.120530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f8f30d-5731-40e5-bb35-7b1cec54b92a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.120530] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f8f30d-5731-40e5-bb35-7b1cec54b92a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.278949] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.279233] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.279395] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.279703] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.279872] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.280078] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 348ccaf4-b040-4233-ae8c-a0ec7cbea147 not found, creating... [ 915.280465] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.280654] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.280792] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.281064] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.281212] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.281539] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.281720] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.281852] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.282110] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.282325] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.282471] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 348ccaf4-b040-4233-ae8c-a0ec7cbea147 is going to be created. [ 915.302962] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.303222] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.303374] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.303631] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.303870] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.304111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.606552] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 915.606728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.623266] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6f8f30d-5731-40e5-bb35-7b1cec54b92a [ 915.623505] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.623710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.623710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.623918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.624016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.624115] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6f8f30d-5731-40e5-bb35-7b1cec54b92a already deleted. [ 915.624196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f8f30d-5731-40e5-bb35-7b1cec54b92a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [req-a7b4923c-ae11-4e09-977c-c2589120520b req-cc3aa5cd-53c6-40dd-8ddd-154da390b6b0 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [req-a7b4923c-ae11-4e09-977c-c2589120520b req-cc3aa5cd-53c6-40dd-8ddd-154da390b6b0 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [req-a7b4923c-ae11-4e09-977c-c2589120520b req-cc3aa5cd-53c6-40dd-8ddd-154da390b6b0 service nova] Enqueued Resource ID: 348ccaf4-b040-4233-ae8c-a0ec7cbea147 with Priority: HIGHEST for action port [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 915.987345] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 348ccaf4-b040-4233-ae8c-a0ec7cbea147 with Priority: HIGHEST for action port [ 915.991061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.991336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.991742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.992930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.992930] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.994116] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.994116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.994116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.995467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.995853] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.995853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.995853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.995853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.996096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.996096] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.999602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-348ccaf4-b040-4233-ae8c-a0ec7cbea147 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.999602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.999602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.999602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.999602] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348ccaf4-b040-4233-ae8c-a0ec7cbea147',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.154820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 in Status: SUCCESS [ 916.155013] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66588024-bc1b-4c51-8e2d-4b20cabf9055 deletion is rescheduled due to dependency. [ 916.155197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66588024-bc1b-4c51-8e2d-4b20cabf9055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.502473] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.502473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.502473] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.503564] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 348ccaf4-b040-4233-ae8c-a0ec7cbea147 with status ACTIVE [ 916.503655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.503723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.503760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.504386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.504386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.504386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.504386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.504386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.508075] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.508075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.508075] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 348ccaf4-b040-4233-ae8c-a0ec7cbea147 is going to be updated. [ 916.530803] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.530945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.531032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.531263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.531425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.531584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-348ccaf4-b040-4233-ae8c-a0ec7cbea147" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.634505] env[65231]: INFO networking_nsxv3.common.synchronization [req-f64d7596-c8a6-44f3-baae-8db657f5f0f6 req-66a73521-59cd-4b1d-ad06-0bc7828e4f24 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 916.635050] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 916.635474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.635815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.635815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.636179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.636559] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.636911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.636911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.637412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.637555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.637696] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.942821] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.942821] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.942821] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.942974] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.943227] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.943381] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.943496] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.943715] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.943857] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.944128] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.944266] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.944393] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.944501] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.944609] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.944714] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.944856] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.964834] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.964986] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.965087] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.965771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.965771] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-0178425e-932c-4746-a000-1b25dfb4fb74 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.965771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.965982] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.966276] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.966382] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0178425e-932c-4746-a000-1b25dfb4fb74',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.008951] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.140210] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.140409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.140449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.140659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.140732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.140959] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.141071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.141127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.141317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.141396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.141427] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 already deleted. [ 917.141507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.470712] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.470935] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.471122] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.471353] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.471501] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.471653] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 0178425e-932c-4746-a000-1b25dfb4fb74 not found, creating... [ 917.471902] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.472067] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.472256] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.476259] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.476500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.476921] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.477133] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.477269] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.477519] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.477661] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.477823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 0178425e-932c-4746-a000-1b25dfb4fb74 is going to be created. [ 917.499863] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.500112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.500252] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.500563] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.500753] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.500960] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.511242] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.511443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.511524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.511739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.511849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.511938] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 917.546883] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.546883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.546883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.546883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.546883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.557048] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 917.924408] env[65231]: INFO networking_nsxv3.common.synchronization [None req-86cdf06c-a791-401a-8582-afb8c12a2eb4 None None] Enqueued Resource ID: aa6ed772-38d5-40af-8e2b-8c75cd9f9278 with Priority: HIGHEST for action port [ 917.924943] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6ed772-38d5-40af-8e2b-8c75cd9f9278 with Priority: HIGHEST for action port [ 917.925351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa6ed772-38d5-40af-8e2b-8c75cd9f9278 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.925483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa6ed772-38d5-40af-8e2b-8c75cd9f9278" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.925548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa6ed772-38d5-40af-8e2b-8c75cd9f9278" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.925800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa6ed772-38d5-40af-8e2b-8c75cd9f9278" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.925881] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa6ed772-38d5-40af-8e2b-8c75cd9f9278',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.237966] env[65231]: INFO networking_nsxv3.common.synchronization [req-f64d7596-c8a6-44f3-baae-8db657f5f0f6 req-c16e578d-1b28-4c60-a16e-879583c9ea0a service nova] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 918.238366] env[65231]: INFO networking_nsxv3.common.synchronization [req-f64d7596-c8a6-44f3-baae-8db657f5f0f6 req-c16e578d-1b28-4c60-a16e-879583c9ea0a service nova] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 918.238366] env[65231]: INFO networking_nsxv3.common.synchronization [req-f64d7596-c8a6-44f3-baae-8db657f5f0f6 req-c16e578d-1b28-4c60-a16e-879583c9ea0a service nova] Enqueued Resource ID: 0178425e-932c-4746-a000-1b25dfb4fb74 with Priority: HIGHEST for action port [ 918.238888] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_rules [ 918.243682] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 918.243682] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0178425e-932c-4746-a000-1b25dfb4fb74 with Priority: HIGHEST for action port [ 918.243682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.243682] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.243682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.243682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.243682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.243682] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.243682] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-0178425e-932c-4746-a000-1b25dfb4fb74 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.246109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.246308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.246570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.246758] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0178425e-932c-4746-a000-1b25dfb4fb74',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.428160] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa6ed772-38d5-40af-8e2b-8c75cd9f9278 [ 918.428398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.428542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.428614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.428823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.428908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.429000] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa6ed772-38d5-40af-8e2b-8c75cd9f9278 already deleted. [ 918.429110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa6ed772-38d5-40af-8e2b-8c75cd9f9278" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.748973] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.750130] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.750312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.750668] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0178425e-932c-4746-a000-1b25dfb4fb74 with status ACTIVE [ 918.750719] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.751691] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.751691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.751931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.751931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.752088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.752088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.752276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.752306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.752681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.752681] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0178425e-932c-4746-a000-1b25dfb4fb74 is going to be updated. [ 918.778919] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.779111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.779208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.779445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.779809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.780033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0178425e-932c-4746-a000-1b25dfb4fb74" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.209643] env[65231]: INFO networking_nsxv3.common.synchronization [None req-1a7f79b2-9005-4a34-b40d-3a4fd1e55c3a tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 with Priority: HIGHEST for action security_group_rules [ 919.210420] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 with Priority: HIGHEST for action security_group_rules [ 919.210821] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.210984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.211180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.211435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.211535] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764f8d3c-ff8f-4db3-9b16-fb9379cdac56',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.254754] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.350938] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0f59a4fd-46e6-4b7e-ab01-dbd108ac27f4 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 with Priority: HIGHEST for action security_group_rules [ 919.353033] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 with Priority: HIGHEST for action security_group_rules [ 919.353343] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.353485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.572275] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 919.572391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.572840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.572932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.573154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.573297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.573397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.573631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.573729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.573951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.574055] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.733450] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.733450] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 already deleted. [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.733450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.733450] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764f8d3c-ff8f-4db3-9b16-fb9379cdac56',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.760538] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.760703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.760790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.761024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.761818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.761818] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 is going to be created. [ 919.805348] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.805518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.805571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.805848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.806077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.820020] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: UNINITIALIZED for 2s [ 920.079385] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.079566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.079629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.080258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.080258] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.080258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.080507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.080507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.080617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.080765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.080913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.080990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.081050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.081623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.081623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.081623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.081623] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.082109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.082109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.082109] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.082109] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.257022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.257379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.257379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.258099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.258099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.258099] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764f8d3c-ff8f-4db3-9b16-fb9379cdac56 already deleted. [ 920.258099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764f8d3c-ff8f-4db3-9b16-fb9379cdac56" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.584593] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f698486-5433-4f5d-838f-8989284e2ed7: rpc.has_security_group_logging(os_id): False [ 920.604355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.604676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.604803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.605073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.605195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.605476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.605615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.605685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.605941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.606048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.606307] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.606414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.606721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.606966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.607072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.607349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.607537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.607650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.607911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.608066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.608183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 920.703657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.703818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.703888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.704108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.704259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.726324] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 921.838671] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: SUCCESS [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.838671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.838671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.838671] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.343492] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.554243] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe1dfdfd-a559-45d2-8f70-ac96b173ba75 req-054e052b-820c-410f-a5ee-3a0fd4269cec tempest-ServersAdminTestJSON-1039088323 tempest-ServersAdminTestJSON-1039088323-project-member] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 922.554859] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGHEST for action security_group_members [ 922.555196] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.555465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.555465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.555703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.555757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.556266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.556266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.556266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.556266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.556266] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.742873] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 922.742873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.847587] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcecc58c-6471-4f02-a7e2-fe8324893375: rpc.has_security_group_logging(os_id): False [ 922.867538] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.871211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.871303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.871534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.871631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.871902] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.872042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.872081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.872264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.872334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.872426] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 is going to be created. [ 922.917538] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1bdb444-883c-4675-abf8-009b2f90470c req-f06737c1-a5c2-408e-a5e0-2bc0012810b9 tempest-ServerRescueTestJSON-1984384378 tempest-ServerRescueTestJSON-1984384378-project-member] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 922.917538] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 922.918027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.918144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.918875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.918875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.918875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.918875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.918875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.919209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.919209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.919209] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.964813] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.964978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.965024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.965227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.965442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.981521] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: IN_PROGRESS for 2s [ 923.061731] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.062042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.062123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.062782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.062884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.063108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.063209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.063290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.064041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.064041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.064041] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be updated. [ 923.101513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.101787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.101875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.102120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.102341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.114236] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: IN_PROGRESS for 2s [ 923.416390] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.416390] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.416611] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.416897] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.417186] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.417352] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.417465] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.417743] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.417911] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.418165] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.418308] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.418430] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.418580] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.418701] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.418803] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.418937] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.583382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.583721] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.584155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.584205] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 already deleted. [ 923.584798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.610910] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.610910] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.192 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.610910] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.611195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.611514] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.611711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.611799] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.613814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.613814] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80a5a47-2c92-4d4a-ba18-bd3df5c4387d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.115940] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.116431] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.116431] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.116431] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.116550] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.117077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port c80a5a47-2c92-4d4a-ba18-bd3df5c4387d not found, creating... [ 924.117077] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.117227] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.117284] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.117634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.117634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.117914] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.118135] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.118195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.118372] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.118498] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.118626] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: c80a5a47-2c92-4d4a-ba18-bd3df5c4387d is going to be created. [ 924.139501] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.139699] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.139822] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.140105] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.140331] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.140557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.697530] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1bdb444-883c-4675-abf8-009b2f90470c req-9e51a245-e4f0-4271-854f-790a15313b16 service nova] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_rules [ 924.697715] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1bdb444-883c-4675-abf8-009b2f90470c req-9e51a245-e4f0-4271-854f-790a15313b16 service nova] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 924.697851] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1bdb444-883c-4675-abf8-009b2f90470c req-9e51a245-e4f0-4271-854f-790a15313b16 service nova] Enqueued Resource ID: c80a5a47-2c92-4d4a-ba18-bd3df5c4387d with Priority: HIGHEST for action port [ 924.700813] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_rules [ 924.700980] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 924.701087] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80a5a47-2c92-4d4a-ba18-bd3df5c4387d with Priority: HIGHEST for action port [ 924.701460] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.701621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.701676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.702331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.702461] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.704290] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.704417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.704487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.704709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.704874] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.704976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.705067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.705244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.705359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.705468] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.706557] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.706691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.707135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.707389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.707476] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80a5a47-2c92-4d4a-ba18-bd3df5c4387d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.996188] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: SUCCESS [ 924.996474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.127103] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 in Status: SUCCESS [ 925.127442] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 deletion is rescheduled due to dependency. [ 925.127442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.209674] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.209674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.209996] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.210990] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c80a5a47-2c92-4d4a-ba18-bd3df5c4387d with status ACTIVE [ 925.212085] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.212085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.212085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.212085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.212085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.212085] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.212506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.212506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.212506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.212506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.212623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.212735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.212792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.213228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.213228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.213419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c80a5a47-2c92-4d4a-ba18-bd3df5c4387d is going to be updated. [ 925.227569] env[65231]: INFO networking_nsxv3.common.synchronization [req-f7ca4f2f-7ade-448b-95f2-83a001b3c7eb req-995add80-c984-4d13-a1b2-67f1a15faa59 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 925.227569] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 925.228064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.228450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.228647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.229230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.229585] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.232084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.232084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.232084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.232084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.232084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.241668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.241668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.241668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.241668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.241668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.241668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c80a5a47-2c92-4d4a-ba18-bd3df5c4387d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.716685] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.735793] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.735972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.736077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.736316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.736415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.736621] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.736718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.736779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.737322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.737409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.737500] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 925.773359] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.773462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.773504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.774670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.774670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.785638] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 926.219252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.219797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.219797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.219797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.219797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.220553] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be created. [ 926.253265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.253265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.253265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.253612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.254116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.269025] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: UNINITIALIZED for 2s [ 926.787151] env[65231]: INFO networking_nsxv3.common.synchronization [None req-93c05199-5b5b-4737-a331-dc33ccf3c9dc None None] Enqueued Resource ID: 72efd0f4-ebd9-47e2-89c2-80849d0eaa10 with Priority: HIGHEST for action port [ 926.787151] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72efd0f4-ebd9-47e2-89c2-80849d0eaa10 with Priority: HIGHEST for action port [ 926.787331] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-72efd0f4-ebd9-47e2-89c2-80849d0eaa10 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.787687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72efd0f4-ebd9-47e2-89c2-80849d0eaa10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.787866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72efd0f4-ebd9-47e2-89c2-80849d0eaa10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.789649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72efd0f4-ebd9-47e2-89c2-80849d0eaa10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.789649] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72efd0f4-ebd9-47e2-89c2-80849d0eaa10',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.292696] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72efd0f4-ebd9-47e2-89c2-80849d0eaa10 [ 927.292942] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.293020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.293067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.293293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.294568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.294689] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72efd0f4-ebd9-47e2-89c2-80849d0eaa10 already deleted. [ 927.294790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72efd0f4-ebd9-47e2-89c2-80849d0eaa10" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.797253] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 927.797253] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 927.797253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.280763] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 928.280763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.280763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.280763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.280763] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.280993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.280993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.281089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.281195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.281307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.281753] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.314228] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2458d0b0-a219-40fa-b9cb-ca3a83fe5828 tempest-ServersTestManualDisk-1198264053 tempest-ServersTestManualDisk-1198264053-project-member] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 928.316333] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 928.316333] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.316333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.316333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.316333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.316333] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.427345] env[65231]: INFO networking_nsxv3.common.synchronization [None req-b4de4252-fb20-472b-9b8f-d5818339716d tempest-ServersTestManualDisk-1198264053 tempest-ServersTestManualDisk-1198264053-project-member] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 928.427928] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 928.428175] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.428278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.786227] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.786227] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.786227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.786924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.788034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.788034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.788034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.788034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.788034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.788577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.788804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.789052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.789478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.789478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.790192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.790192] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.842802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.843050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.843138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.843502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.843644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.843828] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 already deleted. [ 928.843966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.844206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.844485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.844565] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.293076] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43373c35-f1da-468d-a81a-368c06b022b4: rpc.has_security_group_logging(os_id): False [ 929.316530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.316530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.317023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.317023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.317023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.317220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.317220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.317335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.317494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.317585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.317806] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.317907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.317907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.318035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.318184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.318499] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.318499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.318499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.318769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.318769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.318769] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be created. [ 929.372530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.372745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.372745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.373306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.373306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.373306] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 already deleted. [ 929.373306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.407955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.407955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.407955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.407955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.407955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.421044] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 929.507023] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0850f4c2-4a56-4641-bdbd-6497e9eb00e4 None None] Enqueued Resource ID: 58fb3966-295f-44d1-ba1b-b90c009aad40 with Priority: HIGHEST for action port [ 929.507023] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58fb3966-295f-44d1-ba1b-b90c009aad40 with Priority: HIGHEST for action port [ 929.507373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-58fb3966-295f-44d1-ba1b-b90c009aad40 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.507671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58fb3966-295f-44d1-ba1b-b90c009aad40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.507847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58fb3966-295f-44d1-ba1b-b90c009aad40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.508244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58fb3966-295f-44d1-ba1b-b90c009aad40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.508512] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58fb3966-295f-44d1-ba1b-b90c009aad40',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.011989] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58fb3966-295f-44d1-ba1b-b90c009aad40 [ 930.012352] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.012568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.014117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.014117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.014117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.014117] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58fb3966-295f-44d1-ba1b-b90c009aad40 already deleted. [ 930.014117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58fb3966-295f-44d1-ba1b-b90c009aad40" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.077037] env[65231]: INFO networking_nsxv3.common.synchronization [req-0939d42f-2238-402b-829c-138ddcac0f0e req-0998c853-fb4c-40a3-bb46-864fc0215b3c tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 930.078114] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 930.078458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.078642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.078742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.079047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.079285] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.079439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.079538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.079776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.079904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.080610] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.586671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.587078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.587078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.587379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.587507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.588058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.588058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.588058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.588300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.588335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.588462] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 930.629592] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.629592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.629592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.629592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.629592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.639048] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 930.705471] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.705698] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.705818] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.709016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.709016] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.709016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.709016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.709016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.709016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.709016] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.709016] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.709016] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.709016] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.709016] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.709016] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.709016] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.745656] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.745656] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.745656] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.745656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.745656] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-abd99033-69af-4966-a339-924ffa1563fc taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.745656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.745656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.745656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.745656] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd99033-69af-4966-a339-924ffa1563fc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.252279] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.252576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.253766] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.253766] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.253766] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.253766] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port abd99033-69af-4966-a339-924ffa1563fc not found, creating... [ 931.254077] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.254077] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.254219] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.254385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.254546] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.254936] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.255694] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.255694] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.255694] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.255694] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.256044] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: abd99033-69af-4966-a339-924ffa1563fc is going to be created. [ 931.279197] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.279430] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.279569] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.279868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.280139] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.280418] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.435630] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 931.435889] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.856099] env[65231]: INFO networking_nsxv3.common.synchronization [req-e864e8d6-6a43-46f1-b380-675cfaeb5827 req-711cd8c7-9711-47d5-a875-3721bc5bb374 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 931.857193] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 931.857193] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.857193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.857193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.857507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.861423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.861423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.861423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.861423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.861423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.861423] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.044502] env[65231]: INFO networking_nsxv3.common.synchronization [req-0939d42f-2238-402b-829c-138ddcac0f0e req-9402a377-f193-4edf-a388-8c19811d5be6 service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 932.044849] env[65231]: INFO networking_nsxv3.common.synchronization [req-0939d42f-2238-402b-829c-138ddcac0f0e req-9402a377-f193-4edf-a388-8c19811d5be6 service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 932.045231] env[65231]: INFO networking_nsxv3.common.synchronization [req-0939d42f-2238-402b-829c-138ddcac0f0e req-9402a377-f193-4edf-a388-8c19811d5be6 service nova] Enqueued Resource ID: abd99033-69af-4966-a339-924ffa1563fc with Priority: HIGHEST for action port [ 932.045849] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 932.046227] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 932.046365] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd99033-69af-4966-a339-924ffa1563fc with Priority: HIGHEST for action port [ 932.046672] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.046843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.046914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.047204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.047289] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.048293] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.048440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.048646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd99033-69af-4966-a339-924ffa1563fc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.048747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.048839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.049016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.049099] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd99033-69af-4966-a339-924ffa1563fc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.361640] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.550897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.551263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.551481] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abd99033-69af-4966-a339-924ffa1563fc with status ACTIVE [ 932.551684] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.551769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.551842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.552058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.552224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.552451] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.552551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.552751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.552819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.552868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.553236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.553236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.553236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.553425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.553459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.553553] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abd99033-69af-4966-a339-924ffa1563fc is going to be updated. [ 932.578924] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.579147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.579147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.579580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.579580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.579947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd99033-69af-4966-a339-924ffa1563fc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.650435] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 4s [ 932.672126] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f1e37fc0-cca3-4fb6-b7b9-d2be1fd6038e tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 932.673830] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 932.674368] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.674533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.865740] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.370415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.370415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.370415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.370415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.370841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.370841] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 933.400675] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.400962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.400962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.401189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.401345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.412851] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 934.182908] env[65231]: INFO networking_nsxv3.common.synchronization [None req-661d0839-0d4e-48e3-968d-ad2e1cab64fa None None] Enqueued Resource ID: f31a52b6-71ce-4a7a-a6ea-3575dc709385 with Priority: HIGHEST for action port [ 934.183558] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f31a52b6-71ce-4a7a-a6ea-3575dc709385 with Priority: HIGHEST for action port [ 934.183948] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f31a52b6-71ce-4a7a-a6ea-3575dc709385 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.184958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f31a52b6-71ce-4a7a-a6ea-3575dc709385" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.184958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f31a52b6-71ce-4a7a-a6ea-3575dc709385" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.184958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f31a52b6-71ce-4a7a-a6ea-3575dc709385" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.184958] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f31a52b6-71ce-4a7a-a6ea-3575dc709385',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.575829] env[65231]: INFO networking_nsxv3.common.synchronization [None req-1d9f2f3f-2986-435d-aa58-718f24efc3be tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 934.576599] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 934.578440] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.578440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.578596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.580973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.581161] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.628789] env[65231]: INFO networking_nsxv3.common.synchronization [req-656220a3-eea8-4be6-a3f5-7533352fea03 req-954603e7-bfa9-4bca-ba2f-64d85374c216 tempest-ServerPasswordTestJSON-1862084256 tempest-ServerPasswordTestJSON-1862084256-project-member] Enqueued Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 934.630148] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 934.630914] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.631132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.631247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.631602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.631823] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.631993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.632174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.632440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.632818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.633059] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.675493] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 934.675748] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 deletion is rescheduled due to dependency. [ 934.675862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.676108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.676506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.676689] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.676786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.676841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.677036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.677122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.677277] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.687224] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f31a52b6-71ce-4a7a-a6ea-3575dc709385 [ 934.687547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.687735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.687822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.688103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.688197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.688391] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f31a52b6-71ce-4a7a-a6ea-3575dc709385 already deleted. [ 934.688524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f31a52b6-71ce-4a7a-a6ea-3575dc709385" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.786072] env[65231]: INFO networking_nsxv3.common.synchronization [None req-25d4ebf3-6aa9-4eac-9643-66f030d035ed tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 934.786072] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 934.786072] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.786072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.108927] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.109099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.109206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.109527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.109641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.109749] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 already deleted. [ 935.110103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.110103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.110267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.110441] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.133081] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.133081] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.133081] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.133297] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.134030] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.134236] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.134360] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.134607] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.134749] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.135224] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.135224] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.135224] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.135398] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.135466] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.135565] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.135709] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.137566] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.137703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.137805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.137966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.138064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.138253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.138355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.138437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.138674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.138722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.138853] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 already deleted. [ 935.138920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.161067] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.161280] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.161391] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.161574] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-363" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.161893] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-35e22070-c56d-4890-8a9d-b2682499f9b5 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.162112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.162193] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.162767] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.162887] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e22070-c56d-4890-8a9d-b2682499f9b5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.179906] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.425077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 935.425420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.425420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.425947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.425947] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.425947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.425947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.426216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.426216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.426216] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.638388] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.638470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.638597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.642266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.642502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.642627] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 already deleted. [ 935.642714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.665162] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.665399] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.665772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.665916] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.665978] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.666110] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 35e22070-c56d-4890-8a9d-b2682499f9b5 not found, creating... [ 935.666378] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.666519] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.666634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.666971] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.667147] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.667446] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.667594] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.667698] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.667903] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.668240] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.668240] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 35e22070-c56d-4890-8a9d-b2682499f9b5 is going to be created. [ 935.682297] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.696056] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.696056] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.696056] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.696056] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.696429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.697034] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.928671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.928859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.929067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.929335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.929441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.929654] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.929755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.929823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.929972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.930051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.930137] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 935.968712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.969852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.969852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.969852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.969852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.980107] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 936.185644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.185893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.185893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.186225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.186395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.186395] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 936.231053] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.231053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.231053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.231053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.231360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.242393] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 936.316947] env[65231]: INFO networking_nsxv3.common.synchronization [req-94353435-65f0-466e-b496-cfd71ecb6bdc req-6282732a-fe87-414c-b763-0a7a6c32cf9d tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 936.320053] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28923db-4093-40f3-b394-1a2f62eeee3d with Priority: HIGHEST for action security_group_members [ 936.320449] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d28923db-4093-40f3-b394-1a2f62eeee3d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.320624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.320733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.320908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.321449] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.321449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.321449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.321449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.321449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.322288] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d28923db-4093-40f3-b394-1a2f62eeee3d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.490885] env[65231]: INFO networking_nsxv3.common.synchronization [req-656220a3-eea8-4be6-a3f5-7533352fea03 req-542f889c-e117-44cc-8f4e-b18930e177dc service nova] Enqueued Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_rules [ 936.491407] env[65231]: INFO networking_nsxv3.common.synchronization [req-656220a3-eea8-4be6-a3f5-7533352fea03 req-542f889c-e117-44cc-8f4e-b18930e177dc service nova] Enqueued Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 936.491762] env[65231]: INFO networking_nsxv3.common.synchronization [req-656220a3-eea8-4be6-a3f5-7533352fea03 req-542f889c-e117-44cc-8f4e-b18930e177dc service nova] Enqueued Resource ID: 35e22070-c56d-4890-8a9d-b2682499f9b5 with Priority: HIGHEST for action port [ 936.494266] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_rules [ 936.494266] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 936.494266] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e22070-c56d-4890-8a9d-b2682499f9b5 with Priority: HIGHEST for action port [ 936.500233] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.500440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.500585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.501042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.501136] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.502641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.502871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.503020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.504950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.505259] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.506148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.506148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.506148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.506719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.506972] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.508302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e22070-c56d-4890-8a9d-b2682499f9b5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.510208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.510208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.510208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.510208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e22070-c56d-4890-8a9d-b2682499f9b5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.827054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.827054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.827054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.827054] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d is going to be updated. [ 936.861760] env[65231]: INFO networking_nsxv3.common.synchronization [req-0cf69595-71e4-428b-a0c1-80654558b1b5 req-3dcf5306-b913-4970-9389-2764aac8d478 tempest-ServerMetadataTestJSON-1058112602 tempest-ServerMetadataTestJSON-1058112602-project-member] Enqueued Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 936.862507] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGHEST for action security_group_members [ 936.862872] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.862976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.863686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.863686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.863686] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.863686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.863686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.864312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.864312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.864312] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.908824] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f944d551-8312-446f-9289-ea80b4f0339f None None] Enqueued Resource ID: ef2d9e3e-aed0-4172-9edf-ff6747ae86e6 with Priority: HIGHEST for action port [ 936.909565] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2d9e3e-aed0-4172-9edf-ff6747ae86e6 with Priority: HIGHEST for action port [ 936.909915] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2d9e3e-aed0-4172-9edf-ff6747ae86e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.910019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2d9e3e-aed0-4172-9edf-ff6747ae86e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.910071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2d9e3e-aed0-4172-9edf-ff6747ae86e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.910408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2d9e3e-aed0-4172-9edf-ff6747ae86e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.910501] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2d9e3e-aed0-4172-9edf-ff6747ae86e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.914426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.914556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.914850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.914850] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.914972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.925723] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: IN_PROGRESS for 2s [ 936.937622] env[65231]: INFO networking_nsxv3.common.synchronization [req-15011017-9a8a-4cef-9b76-7eb9621a5e7f req-d4e14580-fa30-4518-b77c-5f2af2d7ecb7 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 936.937622] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 936.938591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.938591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.938591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.938591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.938591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.938591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.938994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.938994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.938994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.938994] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.014361] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.014565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.015039] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.015870] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35e22070-c56d-4890-8a9d-b2682499f9b5 with status ACTIVE [ 937.017023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.017023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.017023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.017023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.017023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.017023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.017023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.017365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.017365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.017365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.018557] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.018557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.018557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.018557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.018557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.018557] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35e22070-c56d-4890-8a9d-b2682499f9b5 is going to be updated. [ 937.047523] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.047523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.047523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.047767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.047767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.048185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e22070-c56d-4890-8a9d-b2682499f9b5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.371110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.371110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.371110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.371110] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 is going to be updated. [ 937.375144] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1e556a6-3dce-43d5-b0d7-af698a019903 req-bfa1ef3c-da95-4993-bde0-6a7991b273bc tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 937.375445] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 937.375770] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.375928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.376015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.376220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.376373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.376471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.376533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.376671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.376753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.376845] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.403071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.403297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.403297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.405965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.405965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.414041] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: IN_PROGRESS for 2s [ 937.414239] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef2d9e3e-aed0-4172-9edf-ff6747ae86e6 [ 937.414438] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.414560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.414673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.414940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.414940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.415051] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef2d9e3e-aed0-4172-9edf-ff6747ae86e6 already deleted. [ 937.415088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2d9e3e-aed0-4172-9edf-ff6747ae86e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.443691] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.521323] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.783352] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.783622] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.783767] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.784167] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.784550] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.784750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.784900] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.785178] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.785345] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.785579] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.785710] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.785847] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.785962] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.786113] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.786227] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.786394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.796440] env[65231]: INFO networking_nsxv3.common.synchronization [req-4f2c353d-2ad6-475a-9a35-66c159f9ec2e req-378da01b-8e52-40c2-a2f4-8cc6d76afa3c tempest-ServersWithSpecificFlavorTestJSON-1822531110 tempest-ServersWithSpecificFlavorTestJSON-1822531110-project-member] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 937.797044] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGHEST for action security_group_members [ 937.797426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.797616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.797698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.797923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.798125] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.798231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.798320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.798764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.798764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.798764] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.810391] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.810620] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.811141] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.811141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.811350] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.811582] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.811760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.812118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.812265] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f262e81c-bdb8-4cf1-b5dd-58c690aa6669',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.879531] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.879776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.879895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.880201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.880361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.880635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.880791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.880881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.881151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.881271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.881416] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 937.908544] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.908680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.908732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.908935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.909111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.918782] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 937.947580] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.991130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 937.991322] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 deletion is rescheduled due to dependency. [ 937.991431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.024928] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.025085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.025145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.026035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.026035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.026035] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 is going to be created. [ 938.051415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.051626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.051626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.051816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.052065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.061811] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: UNINITIALIZED for 2s [ 938.257080] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 938.257364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.257604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.257989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.258142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.258318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.258409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.258651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.258744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.258877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.259007] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.300743] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.300915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.300957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.301217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.301326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.301551] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.301648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.301703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.302473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.302473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.302473] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be updated. [ 938.316448] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.316448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.316448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.316448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.316448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.316448] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port f262e81c-bdb8-4cf1-b5dd-58c690aa6669 not found, creating... [ 938.316841] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.316841] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.317332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.317332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.317515] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.317905] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.318941] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.319127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.319362] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.320537] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.320537] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: f262e81c-bdb8-4cf1-b5dd-58c690aa6669 is going to be created. [ 938.337346] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.337495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.338129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.338129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.338129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.341478] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.342170] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.342329] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.342664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.342927] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.343206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.354529] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: IN_PROGRESS for 2s [ 938.452584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.452860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.452974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.453286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.455021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.455021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 938.495423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.495423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.495423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.495423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.495423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.506188] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 938.763200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.763702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.763906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.764298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.764548] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.764701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.764798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.764995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.765122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.765246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.765448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.765575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.765649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.765792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.765978] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.766082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.766192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.766328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.766422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.766953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.766953] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.951617] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d28923db-4093-40f3-b394-1a2f62eeee3d in Status: SUCCESS [ 938.951838] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d28923db-4093-40f3-b394-1a2f62eeee3d deletion is rescheduled due to dependency. [ 938.951961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d28923db-4093-40f3-b394-1a2f62eeee3d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.122809] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1e556a6-3dce-43d5-b0d7-af698a019903 req-adf6639b-83ef-43e6-9b28-18e2008003cc service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 939.122976] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1e556a6-3dce-43d5-b0d7-af698a019903 req-adf6639b-83ef-43e6-9b28-18e2008003cc service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 939.123133] env[65231]: INFO networking_nsxv3.common.synchronization [req-e1e556a6-3dce-43d5-b0d7-af698a019903 req-adf6639b-83ef-43e6-9b28-18e2008003cc service nova] Enqueued Resource ID: f262e81c-bdb8-4cf1-b5dd-58c690aa6669 with Priority: HIGHEST for action port [ 939.123836] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 939.123931] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 939.124087] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f262e81c-bdb8-4cf1-b5dd-58c690aa6669 with Priority: HIGHEST for action port [ 939.124375] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.124530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.124567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.124809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.124887] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.125801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.125913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.126165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.126264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.126323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.126490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.126565] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f262e81c-bdb8-4cf1-b5dd-58c690aa6669',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.274652] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e543173b-3aa1-49c7-bec7-ab450397ef46: rpc.has_security_group_logging(os_id): False [ 939.290884] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.291163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.291265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.291524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.291644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.291913] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.292200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.292400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.292657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.292805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.293130] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.293280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.293368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.293599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.293688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.293907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.294033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.294089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.294259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.294341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.294450] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 939.370847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.370847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.370847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.370847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.370847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.386036] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 939.427028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66402614-4b09-43ce-b9ff-d784c9639b26 in Status: SUCCESS [ 939.427028] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 deletion is rescheduled due to dependency. [ 939.427028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.631186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.631186] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f262e81c-bdb8-4cf1-b5dd-58c690aa6669 with status ACTIVE [ 939.631186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.631186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.631186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.631186] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.631762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.631762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.631762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.631762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.631762] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f262e81c-bdb8-4cf1-b5dd-58c690aa6669 is going to be updated. [ 939.654943] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.655301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.655301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.655653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.655837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.656048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f262e81c-bdb8-4cf1-b5dd-58c690aa6669" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.934130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 939.934392] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 939.934392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.934541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.934778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.934962] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.935086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.935145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.935298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.935369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.935476] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.075180] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: SUCCESS [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.075180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.075180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.075180] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.365230] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 in Status: SUCCESS [ 940.365403] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 deletion is rescheduled due to dependency. [ 940.365515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.438810] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.515572] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 940.515851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.578816] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.579051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.579171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.579507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.579738] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.579875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.579946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.580235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.580382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.580493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.580688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.580754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.580814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.580974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.581143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.581238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.581579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.581816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.581963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.582087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.582208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.943509] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.086944] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3040d0e-55de-46b1-b5fb-234c0b6b3c67: rpc.has_security_group_logging(os_id): False [ 941.114803] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.117530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.117530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.117530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.118060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.118060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.118060] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.118060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.118060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.118060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.118244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.118244] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 is going to be created. [ 941.201565] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.201799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.201851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.202099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.202401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.217700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: IN_PROGRESS for 2s [ 941.401874] env[65231]: INFO networking_nsxv3.common.synchronization [req-8e784fe4-7704-42cb-980a-2ccaea9924e6 req-1b9c0024-1a16-42a2-8e93-300848437be3 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 941.403307] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 941.403659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.404271] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 941.404616] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.404817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.404944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.405181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.405349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.405452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.405517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.405729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.405808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.405906] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.447923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.447923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.447923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.447923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.447923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.447923] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 941.484405] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.484515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.484557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.484928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.485025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.495060] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 941.909017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.909185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.909185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.909429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.910027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.910027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.910027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.910027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.910027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.910353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.910353] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 941.940617] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.940785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.940856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.941129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.941702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.952377] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 942.018315] env[65231]: INFO networking_nsxv3.common.synchronization [req-66a48e17-c23f-4845-a7bb-e4733ae4c409 req-5121bb09-9e48-4485-b458-bbdd0d92a89c tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 942.020701] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 942.021316] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.021892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.021964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.022186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.022366] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.022480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.022541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.022692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.022773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.022865] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.475151] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.475151] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.475151] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.475410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.475619] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.475772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.476717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.476717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.476717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.476717] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.476717] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.476717] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.477032] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.477032] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.477032] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.477137] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.498681] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.498908] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.498970] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.499166] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.499473] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-272b47c9-b79e-4e1f-871c-e39ee9b14087 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.499646] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.499762] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.500118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.500280] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272b47c9-b79e-4e1f-871c-e39ee9b14087',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.525592] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.002944] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.003455] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.003455] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.003595] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.003746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.003907] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 272b47c9-b79e-4e1f-871c-e39ee9b14087 not found, creating... [ 943.004279] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.004436] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.004561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.004826] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.004962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.005358] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.005459] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.005519] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.005728] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.005881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.006046] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 272b47c9-b79e-4e1f-871c-e39ee9b14087 is going to be created. [ 943.028745] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.028962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.029361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.029361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.029668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.029921] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.030875] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.233105] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: SUCCESS [ 943.233264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.509334] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 943.509582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.510253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.510595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.510889] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.511044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.511154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.511419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.511550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.511667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.511776] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.532584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.532761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.532823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.533098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.533195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.533354] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 943.580968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.581205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.581321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.581677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.581973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.595586] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 943.823988] env[65231]: INFO networking_nsxv3.common.synchronization [req-66a48e17-c23f-4845-a7bb-e4733ae4c409 req-84d8a993-8dbb-4157-a334-e80402dc61f3 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 943.823988] env[65231]: INFO networking_nsxv3.common.synchronization [req-66a48e17-c23f-4845-a7bb-e4733ae4c409 req-84d8a993-8dbb-4157-a334-e80402dc61f3 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 943.823988] env[65231]: INFO networking_nsxv3.common.synchronization [req-66a48e17-c23f-4845-a7bb-e4733ae4c409 req-84d8a993-8dbb-4157-a334-e80402dc61f3 service nova] Enqueued Resource ID: 272b47c9-b79e-4e1f-871c-e39ee9b14087 with Priority: HIGHEST for action port [ 943.824238] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 943.824398] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 943.824506] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272b47c9-b79e-4e1f-871c-e39ee9b14087 with Priority: HIGHEST for action port [ 943.824896] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.825097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.825175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.825361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.825580] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.827291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.827421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.827695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-272b47c9-b79e-4e1f-871c-e39ee9b14087 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.827825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.828230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.828433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.828526] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272b47c9-b79e-4e1f-871c-e39ee9b14087',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.965246] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 943.965442] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 943.965603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.015173] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.015173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.015173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.015579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.015579] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.015579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.015708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.015742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.015830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.015914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.016082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.016174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.016233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.016373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.016504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.016594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.016654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.016784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.016857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.016936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.017039] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.329162] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.329162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.332936] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 272b47c9-b79e-4e1f-871c-e39ee9b14087 with status ACTIVE [ 944.332936] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.332936] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.332936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.333391] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.335037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.335037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.335037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.335037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.335037] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 272b47c9-b79e-4e1f-871c-e39ee9b14087 is going to be updated. [ 944.357112] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.357275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.357342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.357620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.357823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.357995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-272b47c9-b79e-4e1f-871c-e39ee9b14087" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.515020] env[65231]: INFO networking_nsxv3.common.synchronization [req-34d73293-6991-4b84-86f6-a5e7c56ac065 req-09cab85a-d0a8-4981-a65b-a2ffb218deac tempest-ServerActionsV293TestJSON-645260172 tempest-ServerActionsV293TestJSON-645260172-project-member] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 944.515020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 944.515020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.515368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.515577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.515967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.518046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.518046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.518046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.518046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.518046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.518046] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.523040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 944.542386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.542386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.542386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.542649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.542756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.543017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.543125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.543189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.543356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.543442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.543635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.543749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.543803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.543938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.544220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.544584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.544636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.545244] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 944.609107] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.609311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.609348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.609552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.609701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.624632] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 944.890744] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.890957] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-695" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.891126] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-695" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.891539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-695" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.891893] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.892052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.892183] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.892456] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.892626] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.892833] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.892948] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.893070] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.893181] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.893320] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.893439] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.893576] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.914536] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.914536] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.914536] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.914728] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-695" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.914966] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-08ae2b71-b622-4e5a-983c-7ba096bef65d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.915168] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.915277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.915591] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.915729] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ae2b71-b622-4e5a-983c-7ba096bef65d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.019057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.019382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.019382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.019659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.019802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.020075] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.020197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.020313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.020530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.020618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.020717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 already deleted. [ 945.020829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.418807] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.419175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.419315] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.419671] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.419830] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.420114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 08ae2b71-b622-4e5a-983c-7ba096bef65d not found, creating... [ 945.420318] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.420496] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.420615] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.420842] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.421046] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.421381] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.421600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.421727] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.421930] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.423466] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.423668] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 08ae2b71-b622-4e5a-983c-7ba096bef65d is going to be created. [ 945.445790] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.446166] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.446443] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.446770] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.447191] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.447516] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.604683] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 945.604898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.605077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.605322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.605506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.605624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.605688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.605832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.605911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.606018] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.108536] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.153369] env[65231]: INFO networking_nsxv3.common.synchronization [req-34d73293-6991-4b84-86f6-a5e7c56ac065 req-72b4f371-ab12-4fe7-a2fc-ce90edd15239 service nova] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 946.153513] env[65231]: INFO networking_nsxv3.common.synchronization [req-34d73293-6991-4b84-86f6-a5e7c56ac065 req-72b4f371-ab12-4fe7-a2fc-ce90edd15239 service nova] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 946.153679] env[65231]: INFO networking_nsxv3.common.synchronization [req-34d73293-6991-4b84-86f6-a5e7c56ac065 req-72b4f371-ab12-4fe7-a2fc-ce90edd15239 service nova] Enqueued Resource ID: 08ae2b71-b622-4e5a-983c-7ba096bef65d with Priority: HIGHEST for action port [ 946.154585] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_rules [ 946.154585] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 946.154585] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ae2b71-b622-4e5a-983c-7ba096bef65d with Priority: HIGHEST for action port [ 946.154770] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.154861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.154935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.155453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.155591] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.157056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.157134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.157220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.157510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.158104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.158104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.158104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.158244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.158244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.161419] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.162397] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ae2b71-b622-4e5a-983c-7ba096bef65d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.162503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.162610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.162769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.162848] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ae2b71-b622-4e5a-983c-7ba096bef65d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.315534] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a83981d0-cc03-4119-bab6-cb8510ebe401 None None] Enqueued Resource ID: 05ccf705-394a-4a41-92c9-21cebd85749b with Priority: HIGHEST for action port [ 946.317099] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ccf705-394a-4a41-92c9-21cebd85749b with Priority: HIGHEST for action port [ 946.317099] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-05ccf705-394a-4a41-92c9-21cebd85749b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.317099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05ccf705-394a-4a41-92c9-21cebd85749b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.317099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05ccf705-394a-4a41-92c9-21cebd85749b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.317349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05ccf705-394a-4a41-92c9-21cebd85749b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.317468] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ccf705-394a-4a41-92c9-21cebd85749b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.611593] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.639766] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 946.639766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.666357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.666357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.666357] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.666357] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08ae2b71-b622-4e5a-983c-7ba096bef65d with status ACTIVE [ 946.666931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.666931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.666931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.667041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.667041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.667768] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.667768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.667768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.667768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.667768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.668109] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.668570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.668570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.668570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.668570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.668730] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08ae2b71-b622-4e5a-983c-7ba096bef65d is going to be updated. [ 946.691539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.691539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.691539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.691785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.691911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.692119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ae2b71-b622-4e5a-983c-7ba096bef65d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.820784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05ccf705-394a-4a41-92c9-21cebd85749b [ 946.821010] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.821161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.821209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.822254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.822254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.822254] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05ccf705-394a-4a41-92c9-21cebd85749b already deleted. [ 946.822254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05ccf705-394a-4a41-92c9-21cebd85749b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.054474] env[65231]: INFO networking_nsxv3.common.synchronization [req-46a9bd9a-8578-423b-9899-e44a6f0ec092 req-3d16698a-7532-46b5-b022-61cc3210f0c8 tempest-ServersTestManualDisk-1198264053 tempest-ServersTestManualDisk-1198264053-project-member] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 947.055163] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 947.055583] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.055723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.055828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.056170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.056376] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.056567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.056657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.056858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.057034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057160] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.113045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.113525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.113525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.113645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.113645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.113765] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 947.148980] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.149154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.149226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.150269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.150499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.161826] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 947.171197] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.516466] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-18 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.516722] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-18" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.516860] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-18" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.517235] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-18" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.518284] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.518472] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.518596] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.518855] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.519011] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.519225] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.519338] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.519517] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.519581] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.519694] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.519798] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.519923] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.538616] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.538794] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.539295] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.539295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-18" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.539447] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-d51d9003-ba6c-4735-a461-a694305a3557 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.539603] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.539721] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.540060] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.540201] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51d9003-ba6c-4735-a461-a694305a3557',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.560630] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.560786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.560858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.561201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.561201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.561374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.561471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.561548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.561678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.561755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.561838] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 already deleted. [ 947.561915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.673641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.673798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.675502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.675502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.675502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.675502] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 is going to be created. [ 947.699591] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.699774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.699842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.700123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.700309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.712097] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: UNINITIALIZED for 2s [ 948.044635] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.044635] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.044635] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.044635] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.044635] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.044635] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port d51d9003-ba6c-4735-a461-a694305a3557 not found, creating... [ 948.045019] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.045019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.045019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.045201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.045418] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.045618] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.045774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.045889] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.046169] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.046401] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.046629] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: d51d9003-ba6c-4735-a461-a694305a3557 is going to be created. [ 948.067210] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.067408] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.067670] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.068072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.068204] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.068425] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.829736] env[65231]: INFO networking_nsxv3.common.synchronization [req-46a9bd9a-8578-423b-9899-e44a6f0ec092 req-0292b4fc-5551-4a5a-b86f-3cbc0ba71422 service nova] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 948.830053] env[65231]: INFO networking_nsxv3.common.synchronization [req-46a9bd9a-8578-423b-9899-e44a6f0ec092 req-0292b4fc-5551-4a5a-b86f-3cbc0ba71422 service nova] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 948.830053] env[65231]: INFO networking_nsxv3.common.synchronization [req-46a9bd9a-8578-423b-9899-e44a6f0ec092 req-0292b4fc-5551-4a5a-b86f-3cbc0ba71422 service nova] Enqueued Resource ID: d51d9003-ba6c-4735-a461-a694305a3557 with Priority: HIGHEST for action port [ 948.831512] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_rules [ 948.831925] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 948.832131] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d9003-ba6c-4735-a461-a694305a3557 with Priority: HIGHEST for action port [ 948.832620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.833078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.833230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.833658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.833919] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.835754] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.836000] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.836161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.836476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.839287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.839287] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.839287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51d9003-ba6c-4735-a461-a694305a3557 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.839287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.839287] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51d9003-ba6c-4735-a461-a694305a3557',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.173912] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 949.174265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.174461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.174720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.175391] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.175525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.175556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.175726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.175802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.175890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.175980] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.340396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.340396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.340627] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.341534] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d51d9003-ba6c-4735-a461-a694305a3557 with status ACTIVE [ 949.341730] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.341865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.341941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.342160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.342251] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.342468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.342578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.342641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.342797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.342876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.343228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.343344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.343405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.343561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.343636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.343748] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d51d9003-ba6c-4735-a461-a694305a3557 is going to be updated. [ 949.368530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.368710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.368710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.368897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.369051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.369219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51d9003-ba6c-4735-a461-a694305a3557" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.681025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.681025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.681025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.681025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.681025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.681639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.681639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.681639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.681639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.681639] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.727463] env[65231]: INFO networking_nsxv3.common.synchronization [req-1b386433-caea-408e-bb35-ade760b9490a req-9ddc8175-1a01-48db-b150-b948449cd9fe tempest-ServerPasswordTestJSON-1862084256 tempest-ServerPasswordTestJSON-1862084256-project-member] Enqueued Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 949.727463] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 with Priority: HIGHEST for action security_group_members [ 949.727898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.728300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.728560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.728972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.729336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.729764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.729764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.732022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.732022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.732022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3040d0e-55de-46b1-b5fb-234c0b6b3c67',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.733108] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: SUCCESS [ 949.733418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.734106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.734825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.735155] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.735401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.735550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.735856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.736050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.736543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.736543] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.846162] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.184119] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 950.207615] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.207615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.207615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.211532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.211532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.211532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.211532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.212546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.212546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.212546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.212546] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 950.239346] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.239649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.239770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.240035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.240192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.240532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.240664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.240738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.240938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.241051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.241146] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 is going to be updated. [ 950.242545] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.297253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.297253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.297253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.297253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.297253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.310792] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: IN_PROGRESS for 2s [ 950.312856] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.312856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.312856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.313181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.313389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.349494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.350152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.350152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.350458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.350592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.350735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 is going to be created. [ 950.364996] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 950.391489] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.391489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.391489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.391489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.391767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.404030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: UNINITIALIZED for 2s [ 950.745530] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b54578a-a5d1-4189-a2be-ff086c792902: rpc.has_security_group_logging(os_id): False [ 950.764061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.764219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.764289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.764571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.764669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.764917] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.765021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.765088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.765243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.765318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.765404] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 is going to be created. [ 950.842875] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.843062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.843144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.844268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.844851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.858068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: IN_PROGRESS for 2s [ 951.917411] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2b519920-2b6d-4d52-9c81-76d384689329 None None] Enqueued Resource ID: aba7979d-5b83-4f81-b93b-938f63e5f2ce with Priority: HIGHEST for action port [ 951.917960] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba7979d-5b83-4f81-b93b-938f63e5f2ce with Priority: HIGHEST for action port [ 951.918277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba7979d-5b83-4f81-b93b-938f63e5f2ce taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.918399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba7979d-5b83-4f81-b93b-938f63e5f2ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.918467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba7979d-5b83-4f81-b93b-938f63e5f2ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.918734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba7979d-5b83-4f81-b93b-938f63e5f2ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.918847] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba7979d-5b83-4f81-b93b-938f63e5f2ce',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.146095] env[65231]: INFO networking_nsxv3.common.synchronization [None req-23bd3a56-93a7-4a91-9aa6-fd666fff8a99 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 952.146513] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 952.146835] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.146955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.147028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.147548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.147653] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.308073] env[65231]: INFO networking_nsxv3.common.synchronization [None req-bc77337c-ca38-4355-9de5-8e8e1fabc7ee tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 952.308598] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 952.308943] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.309039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.320903] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 in Status: SUCCESS [ 952.320903] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3040d0e-55de-46b1-b5fb-234c0b6b3c67 deletion is rescheduled due to dependency. [ 952.320903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3040d0e-55de-46b1-b5fb-234c0b6b3c67" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.379746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 952.379746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.418028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: SUCCESS [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.418028] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.418028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.418028] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.422149] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aba7979d-5b83-4f81-b93b-938f63e5f2ce [ 952.422149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.422149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.422149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.422149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.422431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.422431] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aba7979d-5b83-4f81-b93b-938f63e5f2ce already deleted. [ 952.422431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba7979d-5b83-4f81-b93b-938f63e5f2ce" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.671463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.671463] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 already deleted. [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.671463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.671463] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.877044] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: SUCCESS [ 952.877222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.920075] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.346068] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.346068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.346068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.346068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.346068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.346068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 already deleted. [ 953.346068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.423969] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1183b41-14a7-418b-9e37-1cfcc5aec444: rpc.has_security_group_logging(os_id): False [ 953.444941] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.445172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.445216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.445435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.445531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.445788] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.445910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.445968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.446119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.446188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.446273] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 is going to be created. [ 953.519732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.519937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.521414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.521690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.521899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.537758] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: IN_PROGRESS for 2s [ 954.318086] env[65231]: INFO networking_nsxv3.common.synchronization [None req-30eacc92-a041-41e3-bcc5-349fa293a213 None None] Enqueued Resource ID: 40a8d1e5-4253-4acc-be4c-f1fb033d241f with Priority: HIGHEST for action port [ 954.318530] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a8d1e5-4253-4acc-be4c-f1fb033d241f with Priority: HIGHEST for action port [ 954.318864] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a8d1e5-4253-4acc-be4c-f1fb033d241f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.318960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a8d1e5-4253-4acc-be4c-f1fb033d241f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.319046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a8d1e5-4253-4acc-be4c-f1fb033d241f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.319292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a8d1e5-4253-4acc-be4c-f1fb033d241f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.319502] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a8d1e5-4253-4acc-be4c-f1fb033d241f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.571444] env[65231]: INFO networking_nsxv3.common.synchronization [req-6ac6bfca-3e89-45be-8bad-87d0165cac97 req-63d5c51f-b273-4ad7-97f6-3b9070600a0a tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 954.573628] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 954.574136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.574136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.574294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.574409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.574609] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.574762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.574863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.575044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.575131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.575239] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.822289] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40a8d1e5-4253-4acc-be4c-f1fb033d241f [ 954.824262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.824262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.824262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.824262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.824262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.824262] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40a8d1e5-4253-4acc-be4c-f1fb033d241f already deleted. [ 954.824262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a8d1e5-4253-4acc-be4c-f1fb033d241f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.078106] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.078268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.078342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.079048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.079048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.079048] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.079048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.079048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.079301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.079301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.079301] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 955.120082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.120082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.120082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.120390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.120574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.134981] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 955.552071] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: SUCCESS [ 955.552325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.152498] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 957.153358] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 deletion is rescheduled due to dependency. [ 957.153358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.896267] env[65231]: INFO networking_nsxv3.common.synchronization [req-9138e2f6-bfdd-4e4d-aa5b-ce701ad5abd7 req-121747f0-8a19-4c61-9d80-a7972df10d81 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 958.897034] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 958.897118] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.897425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.897425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.897597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.897650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.897739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.897923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.897923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.898025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.899947] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.192634] env[65231]: INFO networking_nsxv3.common.synchronization [req-55c633cb-ef80-4caa-bd9b-cd3364a1c18d req-aa3b792a-895f-40ef-a69e-69ef75236f02 tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 959.193246] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 959.193571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.193696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.193766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.195574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.195823] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.195978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.197345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.197345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.197345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.197345] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.403987] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.545475] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.545708] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.545836] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.546250] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.546508] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.546665] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.546777] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.546995] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.547202] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.547355] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.547465] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.547573] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.547686] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.547791] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.547942] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.548098] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.571687] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.571880] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.572064] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.572239] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.572626] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.572814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.572925] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.573274] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.573415] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f01ea2c4-db97-45e2-8a71-ad41f5cd2820',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.699274] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.699543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.699694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.700404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.700404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.700626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.700626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.700760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.700890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.700973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.701077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 already deleted. [ 959.701173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.911379] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.077434] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.077666] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.077814] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.078151] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.078310] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.078464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port f01ea2c4-db97-45e2-8a71-ad41f5cd2820 not found, creating... [ 960.078727] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.078885] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.079007] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.079245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.079384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.079682] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.079815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.079929] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.080288] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.080462] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.080631] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: f01ea2c4-db97-45e2-8a71-ad41f5cd2820 is going to be created. [ 960.101846] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.102109] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.102246] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.102557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.102792] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.103020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.413773] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.413947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.414496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.414496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.414496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.414496] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 960.445020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.445020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.445020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.445020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.445020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.453899] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 960.818952] env[65231]: INFO networking_nsxv3.common.synchronization [req-55c633cb-ef80-4caa-bd9b-cd3364a1c18d req-418e34b9-53e2-4534-b983-910f38c479da service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 960.819192] env[65231]: INFO networking_nsxv3.common.synchronization [req-55c633cb-ef80-4caa-bd9b-cd3364a1c18d req-418e34b9-53e2-4534-b983-910f38c479da service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 960.819350] env[65231]: INFO networking_nsxv3.common.synchronization [req-55c633cb-ef80-4caa-bd9b-cd3364a1c18d req-418e34b9-53e2-4534-b983-910f38c479da service nova] Enqueued Resource ID: f01ea2c4-db97-45e2-8a71-ad41f5cd2820 with Priority: HIGHEST for action port [ 960.819921] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 960.820344] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 960.820344] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f01ea2c4-db97-45e2-8a71-ad41f5cd2820 with Priority: HIGHEST for action port [ 960.820680] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.820800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.820866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.821079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.821335] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.825908] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.825908] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.825908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.825908] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.830955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.830955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.830955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.830955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.830955] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f01ea2c4-db97-45e2-8a71-ad41f5cd2820',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.325295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.325295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333208] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.334846] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f01ea2c4-db97-45e2-8a71-ad41f5cd2820 with status ACTIVE [ 961.334846] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.334846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.334846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.334846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.334846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.335198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.335198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.335198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.335316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.335951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.337470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.337470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.337470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.337470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.338986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.338986] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f01ea2c4-db97-45e2-8a71-ad41f5cd2820 is going to be updated. [ 961.363761] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.363907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.363975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.364200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.364337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.364498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f01ea2c4-db97-45e2-8a71-ad41f5cd2820" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.841298] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.345765] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.346059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.346119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.346435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.346524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.346660] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be created. [ 962.379051] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.379255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.379302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.379922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.380103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.390786] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: UNINITIALIZED for 2s [ 962.464369] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 962.465299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.738045] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.738384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.738384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.738649] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.738937] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.739509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.739678] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.739965] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.740184] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.740453] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.740624] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.740899] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.740899] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.741041] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.741041] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.741179] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.759884] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.760072] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.760210] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.760394] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.760712] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.760881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.761011] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.761296] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.761431] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.264929] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.265189] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.265313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.265600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.265877] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.266081] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.266241] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.266354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.266573] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.266719] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.266993] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.267157] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.267271] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.267472] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.267601] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.267736] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c is going to be updated. [ 964.289393] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.289619] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.289700] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.289993] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.290208] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.290444] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.400569] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 964.400803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.400986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.401224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.401424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.401541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.401616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.401806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.401898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.401985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.402109] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.904999] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.094340] env[65231]: INFO networking_nsxv3.common.synchronization [req-81024528-c51a-49d4-b18f-0c6057304cf6 req-e0a55237-f64d-4f1f-aac1-c2b93531e1f6 service nova] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 965.094340] env[65231]: INFO networking_nsxv3.common.synchronization [req-81024528-c51a-49d4-b18f-0c6057304cf6 req-e0a55237-f64d-4f1f-aac1-c2b93531e1f6 service nova] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 965.094340] env[65231]: INFO networking_nsxv3.common.synchronization [req-81024528-c51a-49d4-b18f-0c6057304cf6 req-e0a55237-f64d-4f1f-aac1-c2b93531e1f6 service nova] Enqueued Resource ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with Priority: HIGHEST for action port [ 965.095555] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_rules [ 965.095555] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 965.095555] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with Priority: HIGHEST for action port [ 965.095555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.095555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.095555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.095819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.095819] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.097413] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.097413] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.097413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.098551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.098551] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.098551] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.098551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.098551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.098761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.098761] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.408258] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46aaaa81-68ab-4e7d-baa6-29897d6cee13: rpc.has_security_group_logging(os_id): False [ 965.434306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.435853] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.435853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.436354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.436354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.436354] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be created. [ 965.507827] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.508294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.508437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.508657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.508903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.522088] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 965.601043] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.605502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.605502] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c with status ACTIVE [ 965.605502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.605502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.605502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.607452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.607452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.607452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.607452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.607452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.607452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c is going to be updated. [ 965.634883] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b43fc1b5-73f3-4e38-b49d-4e46e7e9d80c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.110076] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.613944] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.614462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.614673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.615052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.615282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.615497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae is going to be updated. [ 966.653494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.653494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.653494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.653494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.653494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.662120] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: IN_PROGRESS for 2s [ 966.759724] env[65231]: INFO networking_nsxv3.common.synchronization [req-af451cb4-b74d-4633-86cc-296f09a31f88 req-a1e26c46-1d66-4722-b8e8-b1eb312a5e9c tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 966.760429] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 966.760870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.761026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.761026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.761698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.762506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.762506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.762506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.762506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.762506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.763333] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.163323] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.163784] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.163955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.164381] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.164816] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.165159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.165511] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.165910] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.166201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.166794] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.166794] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.166994] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.167201] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.167423] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.167641] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.167884] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.191279] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.191580] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.191841] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.192052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.192470] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-ff02c20a-4560-4a62-977e-250801f2af2a taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.192764] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.193035] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.193435] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.193657] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff02c20a-4560-4a62-977e-250801f2af2a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.265423] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.265848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.265999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.266314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.266472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.266848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.267046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.267165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.267400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.267530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.267674] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 967.294668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.294831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.294876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.295092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.295236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.304783] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 967.536567] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 967.536567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.698245] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.698245] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port ff02c20a-4560-4a62-977e-250801f2af2a not found, creating... [ 967.698245] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.698245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.698711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.698711] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.702480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.702480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.702480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.702480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.702480] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: ff02c20a-4560-4a62-977e-250801f2af2a is going to be created. [ 967.735856] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.737867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.737867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.737867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.737867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.737867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.881023] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9c31b17d-e65e-4349-a9fc-372826025d4f None None] Enqueued Resource ID: 340d5d2a-adbe-4112-8081-3bdc51a7c829 with Priority: HIGHEST for action port [ 967.881023] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 340d5d2a-adbe-4112-8081-3bdc51a7c829 with Priority: HIGHEST for action port [ 967.881337] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-340d5d2a-adbe-4112-8081-3bdc51a7c829 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.881654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-340d5d2a-adbe-4112-8081-3bdc51a7c829" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.881807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-340d5d2a-adbe-4112-8081-3bdc51a7c829" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.882169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-340d5d2a-adbe-4112-8081-3bdc51a7c829" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.882371] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('340d5d2a-adbe-4112-8081-3bdc51a7c829',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.388023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 340d5d2a-adbe-4112-8081-3bdc51a7c829 [ 968.388023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.388023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.388023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.388023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.388023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.388023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:340d5d2a-adbe-4112-8081-3bdc51a7c829 already deleted. [ 968.388023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-340d5d2a-adbe-4112-8081-3bdc51a7c829" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.515210] env[65231]: INFO networking_nsxv3.common.synchronization [req-af451cb4-b74d-4633-86cc-296f09a31f88 req-081e6bc4-be3c-4e88-8949-0a6a9610e48e service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 968.515430] env[65231]: INFO networking_nsxv3.common.synchronization [req-af451cb4-b74d-4633-86cc-296f09a31f88 req-081e6bc4-be3c-4e88-8949-0a6a9610e48e service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 968.515577] env[65231]: INFO networking_nsxv3.common.synchronization [req-af451cb4-b74d-4633-86cc-296f09a31f88 req-081e6bc4-be3c-4e88-8949-0a6a9610e48e service nova] Enqueued Resource ID: ff02c20a-4560-4a62-977e-250801f2af2a with Priority: HIGHEST for action port [ 968.516100] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 968.516224] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 968.517520] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff02c20a-4560-4a62-977e-250801f2af2a with Priority: HIGHEST for action port [ 968.517520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.517520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.517520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.517520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.517520] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.518093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.518196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.518736] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff02c20a-4560-4a62-977e-250801f2af2a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.518848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.518912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.519244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.519244] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff02c20a-4560-4a62-977e-250801f2af2a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.673201] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: IN_PROGRESS for 4s [ 969.020650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.020844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.025417] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff02c20a-4560-4a62-977e-250801f2af2a with status ACTIVE [ 969.025639] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.025773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.025839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.026063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.026180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.026327] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.026426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.028688] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.028688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.028688] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff02c20a-4560-4a62-977e-250801f2af2a is going to be updated. [ 969.052503] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.052718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.052789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.052992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.053147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.053392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff02c20a-4560-4a62-977e-250801f2af2a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.164779] env[65231]: INFO networking_nsxv3.common.synchronization [None req-09ba7ec8-4e62-4080-83a5-b1eb28e6d743 tempest-ServersTestFqdnHostnames-16005605 tempest-ServersTestFqdnHostnames-16005605-project-member] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 969.165658] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 969.166749] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.166749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.166749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.167115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.167115] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.299358] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f8a6a39a-a584-4d7d-a26d-9e70689f8d16 tempest-ServersTestFqdnHostnames-16005605 tempest-ServersTestFqdnHostnames-16005605-project-member] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 969.299734] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 969.300054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.300162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.379352] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 969.379541] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 969.379734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.379820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.380103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.380478] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.380478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.380478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.380651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.380718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.380790] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.689577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.689577] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab779d2-9149-4b17-970e-1cc363dd590f already deleted. [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.689577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.689577] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.885486] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.221239] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.222434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.222434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.222434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.222434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.222434] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab779d2-9149-4b17-970e-1cc363dd590f already deleted. [ 970.222434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.390442] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.591490] env[65231]: INFO networking_nsxv3.common.synchronization [None req-8858f03a-71d5-452a-9e0f-29e281432a37 None None] Enqueued Resource ID: 931e5723-71f2-42f4-813c-0eaf50f09798 with Priority: HIGHEST for action port [ 970.592153] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 931e5723-71f2-42f4-813c-0eaf50f09798 with Priority: HIGHEST for action port [ 970.592655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-931e5723-71f2-42f4-813c-0eaf50f09798 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.592830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-931e5723-71f2-42f4-813c-0eaf50f09798" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.592944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-931e5723-71f2-42f4-813c-0eaf50f09798" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.593270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-931e5723-71f2-42f4-813c-0eaf50f09798" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.593368] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('931e5723-71f2-42f4-813c-0eaf50f09798',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.686278] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: SUCCESS [ 970.686466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.686505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.687716] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.687716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.687716] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.893504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.893898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.895105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.895486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.896081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.896155] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 970.931652] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.931652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.931652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.932024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.932316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.947161] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 971.097134] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 931e5723-71f2-42f4-813c-0eaf50f09798 [ 971.097427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.097563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.097653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.097971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.098112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.098239] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:931e5723-71f2-42f4-813c-0eaf50f09798 already deleted. [ 971.098350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-931e5723-71f2-42f4-813c-0eaf50f09798" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.190098] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.526684] env[65231]: INFO networking_nsxv3.common.synchronization [req-06f52624-4ade-44c2-b454-12cbad828291 req-2e8aed11-58ec-4124-8341-5c5f2a3aa65a tempest-ServerRescueTestJSON-1984384378 tempest-ServerRescueTestJSON-1984384378-project-member] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 971.527343] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 971.527707] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.527861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.527942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.528963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.529144] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.529250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.529343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.529541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.529658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.529759] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.694509] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e07d317b-0483-4445-8dd5-93a55bfaf9ae: rpc.has_security_group_logging(os_id): False [ 971.717822] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.718023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.718181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.721021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.721021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.721021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae is going to be updated. [ 971.797047] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.797269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.797351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.797657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.798255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.814474] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: IN_PROGRESS for 2s [ 971.956964] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.957383] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.957383] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.957630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.957922] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.958112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.958246] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.958556] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.958653] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.958927] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.959054] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.959180] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.959307] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.959449] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.959572] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.959714] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.999483] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.999797] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.999971] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.000207] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-513" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.000606] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-3cb5e185-928c-43bb-a657-ec01b2187128 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.000799] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.000926] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.001280] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.001475] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb5e185-928c-43bb-a657-ec01b2187128',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.032646] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.504255] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.505027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.505027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.505027] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.505215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.505412] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 3cb5e185-928c-43bb-a657-ec01b2187128 not found, creating... [ 972.505714] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.505881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.506082] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.506376] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.506528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.507016] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.507121] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.507186] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.507407] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.507539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.507682] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 3cb5e185-928c-43bb-a657-ec01b2187128 is going to be created. [ 972.534199] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.535063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.535063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.535063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.535373] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.535685] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.536758] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.959022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 972.959022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.959350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.959350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.959512] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.959641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.959759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.959848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.959923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.960023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.960113] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.041744] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.041744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.041744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.041744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.041744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.041744] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 973.074805] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.074805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.074805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.074805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.074805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.085969] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 973.287707] env[65231]: INFO networking_nsxv3.common.synchronization [req-06f52624-4ade-44c2-b454-12cbad828291 req-72fd5eba-7466-4668-81c9-f901509654ad service nova] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_rules [ 973.288644] env[65231]: INFO networking_nsxv3.common.synchronization [req-06f52624-4ade-44c2-b454-12cbad828291 req-72fd5eba-7466-4668-81c9-f901509654ad service nova] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 973.288969] env[65231]: INFO networking_nsxv3.common.synchronization [req-06f52624-4ade-44c2-b454-12cbad828291 req-72fd5eba-7466-4668-81c9-f901509654ad service nova] Enqueued Resource ID: 3cb5e185-928c-43bb-a657-ec01b2187128 with Priority: HIGHEST for action port [ 973.289604] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_rules [ 973.289776] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 973.290029] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb5e185-928c-43bb-a657-ec01b2187128 with Priority: HIGHEST for action port [ 973.290364] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.290503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.290575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.290791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.291031] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.292438] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.292637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.292979] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb5e185-928c-43bb-a657-ec01b2187128 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.294302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.294302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.294302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.294302] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb5e185-928c-43bb-a657-ec01b2187128',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.462920] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.463220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.463220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.463434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.464172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.464172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.464172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.464172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.464172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.464574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.464574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.464574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.464574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.464733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.464812] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.464949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.465021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.465168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.465245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.465326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.465414] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.796260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.796493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.798860] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cb5e185-928c-43bb-a657-ec01b2187128 with status ACTIVE [ 973.799061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.799190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.799281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.799600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.799685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.799891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800000] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.800069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.800236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.800317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800497] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.800634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.800634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.800778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.800853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.800937] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cb5e185-928c-43bb-a657-ec01b2187128 is going to be updated. [ 973.831701] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.832296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.832296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.832397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.832600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.832745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb5e185-928c-43bb-a657-ec01b2187128" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.836909] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: SUCCESS [ 973.836909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.968183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d80f7f-757f-4f15-9618-2e66c9f29176: rpc.has_security_group_logging(os_id): False [ 973.997161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.997321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.997385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.997607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.997704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.997918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.998276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.998355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.999354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.999354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.999354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.999916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.999916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.999916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.999916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.999916] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 974.087846] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.087846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.087846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.091489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.091489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.104921] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 975.099214] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 975.099798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.099798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.100292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.100421] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.100657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.100657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.100782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.100844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.101062] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.603606] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.107341] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.124552] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 976.124901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.615609] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.615609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.615609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.615609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.615609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.615609] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 976.654553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.656390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.656539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.659813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.659813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.668202] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 978.291033] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.291033] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 978.680718] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 978.680942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.681146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.681365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.681555] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.681673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.681790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.681952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.682061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.682181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.682279] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.779132] env[65231]: INFO networking_nsxv3.common.synchronization [req-68aad03b-1469-4043-9298-e942393ec34a req-de6432bd-acd3-479a-a206-708c59ae6830 tempest-ServersNegativeTestJSON-1310562200 tempest-ServersNegativeTestJSON-1310562200-project-member] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 978.779132] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 978.780241] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.780559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.781409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.781781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.782665] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.783091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.784793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.784793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.784793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.784793] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.137279] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.137518] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.137696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.138141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.138417] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.138653] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.138830] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.139170] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.139330] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.139568] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.139728] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.139853] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.139979] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.140134] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.140286] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.140433] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.164725] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.164974] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.165239] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.165450] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.165791] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-70fdf875-08a5-4f50-88c7-fe2369444274 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.165981] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.166118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.166439] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.166581] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fdf875-08a5-4f50-88c7-fe2369444274',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.184791] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.185029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.185104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.185298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.185454] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.185550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.185610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.185751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.185868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.185914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.189201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.189201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.189201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.189201] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.286309] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.286599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.286693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.286985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.287187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.287571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.287728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.288045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.288045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.288157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.288311] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 already deleted. [ 979.288413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.670361] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.670807] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.670807] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.671057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.671206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.671362] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 70fdf875-08a5-4f50-88c7-fe2369444274 not found, creating... [ 979.671792] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.672188] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.672360] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.672657] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.672827] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.677290] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.677633] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.677820] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.678187] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.678415] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.678656] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 70fdf875-08a5-4f50-88c7-fe2369444274 is going to be created. [ 979.689104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43373c35-f1da-468d-a81a-368c06b022b4: rpc.has_security_group_logging(os_id): False [ 979.706293] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.706548] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.706676] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.706974] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.707228] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.707462] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.710046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.710046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.710046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.710046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.710552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.710885] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.711020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.711079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.711406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.711515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.711761] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.711890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.711972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.712159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.712256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.712464] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.712608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.712890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.713097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.713203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.713294] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 979.847547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.847762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.847762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.848212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.848212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.874230] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 980.459911] env[65231]: INFO networking_nsxv3.common.synchronization [req-68aad03b-1469-4043-9298-e942393ec34a req-82d54535-7e3d-49a0-81a6-833b48d587ab service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 980.460133] env[65231]: INFO networking_nsxv3.common.synchronization [req-68aad03b-1469-4043-9298-e942393ec34a req-82d54535-7e3d-49a0-81a6-833b48d587ab service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 980.460298] env[65231]: INFO networking_nsxv3.common.synchronization [req-68aad03b-1469-4043-9298-e942393ec34a req-82d54535-7e3d-49a0-81a6-833b48d587ab service nova] Enqueued Resource ID: 70fdf875-08a5-4f50-88c7-fe2369444274 with Priority: HIGHEST for action port [ 980.461585] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 980.461585] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 980.461964] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fdf875-08a5-4f50-88c7-fe2369444274 with Priority: HIGHEST for action port [ 980.463027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.463027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.463027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.463311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.466365] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.467396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.467533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.467669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.469907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.469907] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.469907] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-70fdf875-08a5-4f50-88c7-fe2369444274 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.469907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.469907] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fdf875-08a5-4f50-88c7-fe2369444274',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.972710] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70fdf875-08a5-4f50-88c7-fe2369444274 with status ACTIVE [ 980.972993] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.973155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.973227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.973436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.973703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.973915] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.974032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.974110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.974263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.974350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.974734] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.974734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.974734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.974887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.974887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.975023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70fdf875-08a5-4f50-88c7-fe2369444274 is going to be updated. [ 980.976247] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.976385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.977363] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.997494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.997726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.997726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.998068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.998267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.998470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.399551] env[65231]: INFO networking_nsxv3.common.synchronization [req-84cee831-8426-4384-bb62-aa660f8f3c11 req-496ee676-e6a8-402f-ad38-cddd19b79a9d tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 981.400150] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 981.400448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.400609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.403015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.403015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.403015] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.403015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.403015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.403279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.403279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.403375] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.480500] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.807881] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.807881] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.807881] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.807881] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.807881] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.807881] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.808796] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.808796] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.808796] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.808796] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.829197] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.830063] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.830063] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.830063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.830395] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3058ae5e-95ed-41c2-98f2-9d02fa07a055 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.830527] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.830656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.831033] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.831181] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3058ae5e-95ed-41c2-98f2-9d02fa07a055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.889866] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 981.890175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.908025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.908025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.908025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.909323] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.909323] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 already deleted. [ 981.909323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.983964] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.984375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.984375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.984492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.984548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.984653] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be created. [ 982.010390] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.010390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.010593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.010846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.011088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.026764] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: UNINITIALIZED for 2s [ 982.333855] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.334220] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.334429] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.334826] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.335071] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.335300] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3058ae5e-95ed-41c2-98f2-9d02fa07a055 not found, creating... [ 982.335688] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.335920] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.336116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.336439] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.336648] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.337073] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.337307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.337526] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.337867] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.338087] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.338299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3058ae5e-95ed-41c2-98f2-9d02fa07a055 is going to be created. [ 982.360431] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.360744] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.361578] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.361578] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.361740] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.361920] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.109460] env[65231]: INFO networking_nsxv3.common.synchronization [req-84cee831-8426-4384-bb62-aa660f8f3c11 req-1e0886de-8f54-443f-80ef-4529260fcce5 service nova] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 983.109460] env[65231]: INFO networking_nsxv3.common.synchronization [req-84cee831-8426-4384-bb62-aa660f8f3c11 req-1e0886de-8f54-443f-80ef-4529260fcce5 service nova] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 983.109460] env[65231]: INFO networking_nsxv3.common.synchronization [req-84cee831-8426-4384-bb62-aa660f8f3c11 req-1e0886de-8f54-443f-80ef-4529260fcce5 service nova] Enqueued Resource ID: 3058ae5e-95ed-41c2-98f2-9d02fa07a055 with Priority: HIGHEST for action port [ 983.109460] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 983.109460] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 983.110480] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3058ae5e-95ed-41c2-98f2-9d02fa07a055 with Priority: HIGHEST for action port [ 983.111143] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.117027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.117027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.117027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.117027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.118673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.118974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.119239] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.121365] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3058ae5e-95ed-41c2-98f2-9d02fa07a055 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.121731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.123030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.123030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.123030] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3058ae5e-95ed-41c2-98f2-9d02fa07a055',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.625745] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.626810] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.626919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.627106] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3058ae5e-95ed-41c2-98f2-9d02fa07a055 with status ACTIVE [ 983.627264] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.627367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.627430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.627626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.627817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.628056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.628159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.628265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.628378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.628454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.628631] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.628723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.628781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.629575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.629741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.629847] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3058ae5e-95ed-41c2-98f2-9d02fa07a055 is going to be updated. [ 983.655373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.655590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.655590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.655817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.656053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.656276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3058ae5e-95ed-41c2-98f2-9d02fa07a055" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.038139] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 984.038477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.038702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.038954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.039171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.039307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.039400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.039590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.039693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.039761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.039928] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.132073] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.545572] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.548982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.548982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.548982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.548982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.549793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.549793] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.634281] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.634499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.634499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.634801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.634911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.634982] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be created. [ 984.661828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.662130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.662234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.662478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.662745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.673648] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: UNINITIALIZED for 2s [ 985.053968] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d0c669-d29b-4033-86e4-fdbf9e070f07: rpc.has_security_group_logging(os_id): False [ 985.085034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.085034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.085034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.085438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.085438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.085568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.085657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.085751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.085980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.086108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.086331] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.086450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.087664] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.087664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.088102] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be created. [ 985.173593] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.173593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.173593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.173593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.173593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.191903] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 985.996104] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ec5c783-9efa-4928-b16b-12a1103974b2 req-9c82f805-9e66-44be-8cee-a7bfe8af7065 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 985.996722] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 985.996954] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.997086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.997149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.997346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.997498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.997579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.997642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.997800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.997887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.997992] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.359893] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.359893] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.359893] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.359893] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.360805] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.361051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.361162] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.361410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.361566] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.361788] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.361884] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.362078] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.362266] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.362473] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.362770] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.362985] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.382251] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.382251] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.382377] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.382567] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.382950] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.383241] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.383378] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.383760] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.383931] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.500323] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.683754] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 986.683993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.684270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.684560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.684762] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.684900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.685025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.685277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.685369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.685459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.685551] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.887793] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.888079] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.888228] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.888524] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.888711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.888875] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 not found, creating... [ 986.889826] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.889954] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.890110] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.890427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.892201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.892201] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.892201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.892201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.892201] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.892534] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.892751] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 is going to be created. [ 986.914722] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.915069] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.915285] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.915603] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.916959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.916959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.002930] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.188193] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.206143] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 987.206410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.507407] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.507758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.507758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.507864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.507949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.508059] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 987.551071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.551071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.551071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.551071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.551071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.560938] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 987.691562] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7635576-86a3-4c1e-879c-905a9e43f478: rpc.has_security_group_logging(os_id): False [ 987.711119] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.711272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.711361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.711549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.711720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.712021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.712135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.712200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.712372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.712453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.712591] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be created. [ 987.744327] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ec5c783-9efa-4928-b16b-12a1103974b2 req-edf9f438-3206-4f29-94e8-ec50e0f6e47d service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 987.744507] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ec5c783-9efa-4928-b16b-12a1103974b2 req-edf9f438-3206-4f29-94e8-ec50e0f6e47d service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 987.744642] env[65231]: INFO networking_nsxv3.common.synchronization [req-9ec5c783-9efa-4928-b16b-12a1103974b2 req-edf9f438-3206-4f29-94e8-ec50e0f6e47d service nova] Enqueued Resource ID: 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 with Priority: HIGHEST for action port [ 987.745324] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 987.745488] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 987.745592] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 with Priority: HIGHEST for action port [ 987.745966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.746120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.746179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.746392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.746482] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.747458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.747562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.747768] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.747898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.747971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.748116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.748189] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.802484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.802722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.802722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.802970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.803162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.817467] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 988.251598] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.251843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.254538] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 with status ACTIVE [ 988.254538] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.254538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.254538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.254538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.254538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.255407] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.255407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.255407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.255407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.255407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.255625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.255788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.255921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.256309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.256463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.256728] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0 is going to be updated. [ 988.281713] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.281713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.281998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.281998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.282127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.282269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a33bdd3-9e3e-4fe0-8c8a-c6e0bb9d2df0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.575665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 989.576329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.576329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.576445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.576678] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.576881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.576967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.577180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.577306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.577463] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.831270] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 989.831270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.065122] env[65231]: INFO networking_nsxv3.common.synchronization [req-f86c5047-5876-42b5-be9b-02ca2211009b req-b752e7b6-5fcb-4a43-9b1e-83382217aa58 tempest-ListServerFiltersTestJSON-596018266 tempest-ListServerFiltersTestJSON-596018266-project-member] Enqueued Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 990.066803] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59524d0-6c69-4693-8189-3ea92184056b with Priority: HIGHEST for action security_group_members [ 990.067165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59524d0-6c69-4693-8189-3ea92184056b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.067349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.067448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.067743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.067980] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.068601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.068601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.068601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.068807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.068870] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59524d0-6c69-4693-8189-3ea92184056b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.082796] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.571547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.571761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.571814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.572095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.572142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.572315] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.572413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.572477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.572628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.572786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.572882] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b is going to be updated. [ 990.587520] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.602105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.602374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.602374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.602845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.602845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.612978] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 2s [ 991.090442] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.090710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.090774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.091045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.091141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.091192] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 991.124804] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.125022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.125022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.125228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.125373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.151454] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 992.623870] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: IN_PROGRESS for 4s [ 993.162746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 993.162976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.163457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.163716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.164429] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.164552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.164618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.164783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.164861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.164943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.165404] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.527481] env[65231]: INFO networking_nsxv3.common.synchronization [req-95d1b25d-d068-4245-9715-c52b28abbca9 req-43402b88-ae6d-4c72-aa4d-846ce1f7b6ff tempest-ServersTestManualDisk-1198264053 tempest-ServersTestManualDisk-1198264053-project-member] Enqueued Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 993.531449] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 with Priority: HIGHEST for action security_group_members [ 993.532225] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1183b41-14a7-418b-9e37-1cfcc5aec444 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.532366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.532436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.532649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.532900] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.533016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.533082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.533261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.533346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.533444] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1183b41-14a7-418b-9e37-1cfcc5aec444',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.668302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.668724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.668724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.668947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.669211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.669362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.669458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.669694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.669844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.669979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.670230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.670374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.670482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.670707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.670924] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.672803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.672803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.673203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.673550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.673737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.673908] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.036385] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.036551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.036624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.036844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.036940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.037310] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.037310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.037310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.037515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.037515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.037583] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 is going to be updated. [ 994.082919] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.083299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.083425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.083751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.083971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.096728] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: IN_PROGRESS for 2s [ 994.179563] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 994.207283] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.207450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.210037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.210037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.210037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.210505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.212179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.212374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.217112] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.217438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.217599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.217902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.218042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.218181] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 994.306637] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.306637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.306637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.306637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.306637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.324387] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 994.637932] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59524d0-6c69-4693-8189-3ea92184056b in Status: SUCCESS [ 994.638149] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59524d0-6c69-4693-8189-3ea92184056b deletion is rescheduled due to dependency. [ 994.638270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59524d0-6c69-4693-8189-3ea92184056b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.233335] env[65231]: INFO networking_nsxv3.common.synchronization [req-6d1e287d-d7c4-4b0d-b388-1884359b2f87 req-a4e66904-7134-4bf8-9b57-ea5c6aac8b93 tempest-ServersTestFqdnHostnames-16005605 tempest-ServersTestFqdnHostnames-16005605-project-member] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 995.234379] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 995.234937] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.234937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.234937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.236358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.236358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.236358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.236358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.236358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.236358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.236358] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.675997] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.676203] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.676334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.676661] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.676917] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.677280] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.677503] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.677646] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.677797] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.677997] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.678125] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.678232] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.678337] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.678441] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.678545] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.678676] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.700955] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.701152] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.701292] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.701469] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.701779] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-95601549-dfdb-45d8-b5f4-e871a95454c5 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.702016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.702170] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.702494] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.702686] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95601549-dfdb-45d8-b5f4-e871a95454c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.738954] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.740201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.740201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.740201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.740201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.740201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.740201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.740589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.740644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.740763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.740895] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab779d2-9149-4b17-970e-1cc363dd590f already deleted. [ 995.740933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.109045] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 in Status: SUCCESS [ 996.109244] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1183b41-14a7-418b-9e37-1cfcc5aec444 deletion is rescheduled due to dependency. [ 996.109349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1183b41-14a7-418b-9e37-1cfcc5aec444" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.204846] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.205089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.205219] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.205497] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.205640] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.205850] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 95601549-dfdb-45d8-b5f4-e871a95454c5 not found, creating... [ 996.206146] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.206310] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.206426] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.206704] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.207175] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.207369] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.207369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.207491] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.207665] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.207938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.208104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 95601549-dfdb-45d8-b5f4-e871a95454c5 is going to be created. [ 996.232458] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.232738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.232850] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.233538] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.233538] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.233887] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.345350] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 996.345350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.623931] env[65231]: INFO networking_nsxv3.common.synchronization [req-3887be73-2c0d-4bf9-b628-b77651800358 req-458959c8-38fe-4af6-b873-8d61a4130843 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 996.624549] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 996.624960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.625747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.625825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.626051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.626228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.626339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.626407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.626638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.626752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.626853] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.984443] env[65231]: INFO networking_nsxv3.common.synchronization [req-6d1e287d-d7c4-4b0d-b388-1884359b2f87 req-d76fbb9d-372a-49ee-8e21-57e083be0e6d service nova] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 996.986857] env[65231]: INFO networking_nsxv3.common.synchronization [req-6d1e287d-d7c4-4b0d-b388-1884359b2f87 req-d76fbb9d-372a-49ee-8e21-57e083be0e6d service nova] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 996.986857] env[65231]: INFO networking_nsxv3.common.synchronization [req-6d1e287d-d7c4-4b0d-b388-1884359b2f87 req-d76fbb9d-372a-49ee-8e21-57e083be0e6d service nova] Enqueued Resource ID: 95601549-dfdb-45d8-b5f4-e871a95454c5 with Priority: HIGHEST for action port [ 996.986857] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_rules [ 996.986857] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 996.986857] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95601549-dfdb-45d8-b5f4-e871a95454c5 with Priority: HIGHEST for action port [ 996.986857] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.986857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.986857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.986857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.986857] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.987916] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.987916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.987916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.987916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.987916] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.988201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.988201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.988348] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.988438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.988544] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.989840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-95601549-dfdb-45d8-b5f4-e871a95454c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.989840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.989840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.989840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.989840] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95601549-dfdb-45d8-b5f4-e871a95454c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.130666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.130859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.130901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.131504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.131504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.131504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.131504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.131766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.131766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.131766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.131929] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 997.211068] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.211265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.211354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.211590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.211831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.226397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 997.492634] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.493034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.493083] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95601549-dfdb-45d8-b5f4-e871a95454c5 with status ACTIVE [ 997.493325] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.493479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.493582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.493859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.493951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.494139] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.494238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.494301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.494460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.494537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.494769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.494819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.494873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.495094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.495094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.495199] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95601549-dfdb-45d8-b5f4-e871a95454c5 is going to be updated. [ 997.496905] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.520090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.520292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.520292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.520596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.520766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.520951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95601549-dfdb-45d8-b5f4-e871a95454c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.000794] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.097479] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 998.097479] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:2 started [ 998.503329] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.503654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.503654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.503862] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.503902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.504058] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab779d2-9149-4b17-970e-1cc363dd590f is going to be created. [ 998.528950] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.529079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.529142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.529309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.529564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.540576] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: UNINITIALIZED for 2s [ 998.732339] env[65231]: INFO networking_nsxv3.common.synchronization [req-97cc3cbf-924d-4c50-9c64-57e2d639b87e req-9a565c57-b893-4da8-ac3f-b355b689f7d9 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 998.732339] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 998.732665] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.732784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.732827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.734084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.734084] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.734386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.734386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.735281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.735281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.735281] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.116530] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.116791] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.116864] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.117372] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.117648] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.117826] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.117955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.118347] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.118592] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.118911] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.119097] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.119222] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.119333] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.119477] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.119559] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.119722] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.151958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.152167] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 999.152296] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.152490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-366" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.152910] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-7763fdfb-4387-462d-97c4-1daa8af927d1 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.153127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.153249] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.153631] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.153846] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7763fdfb-4387-462d-97c4-1daa8af927d1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.236948] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.237183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.237289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.237579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.237673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.238045] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.238156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.238201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.238389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.238517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.238627] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 999.242118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 999.242306] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 999.242429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.277755] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.277972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.277972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.278234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.278426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.290355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 999.628052] env[65231]: INFO networking_nsxv3.common.synchronization [req-43c21f2a-0e18-4b20-a2ff-b585a8ee72e3 req-87945ec2-7ebb-47c4-bc2c-d6adff372722 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 999.628337] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 999.628383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.628492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.628559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.628755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.628909] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.629017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.629082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.629270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.629341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.629395] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.656586] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.656833] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.656977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.657388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.657605] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.657838] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 7763fdfb-4387-462d-97c4-1daa8af927d1 not found, creating... [ 999.658260] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.658502] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.658691] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.659116] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.659385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.659716] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.659966] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.660170] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.660454] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.660930] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.661034] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 7763fdfb-4387-462d-97c4-1daa8af927d1 is going to be created. [ 999.691034] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.691276] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.691643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.691643] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.691882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.692123] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.051020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.051269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.051269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.051557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.051652] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.131139] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.419416] env[65231]: INFO networking_nsxv3.common.synchronization [req-97cc3cbf-924d-4c50-9c64-57e2d639b87e req-a90378fd-984c-4cd8-b937-6495c26b5164 service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 1000.419599] env[65231]: INFO networking_nsxv3.common.synchronization [req-97cc3cbf-924d-4c50-9c64-57e2d639b87e req-a90378fd-984c-4cd8-b937-6495c26b5164 service nova] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 1000.419737] env[65231]: INFO networking_nsxv3.common.synchronization [req-97cc3cbf-924d-4c50-9c64-57e2d639b87e req-a90378fd-984c-4cd8-b937-6495c26b5164 service nova] Enqueued Resource ID: 7763fdfb-4387-462d-97c4-1daa8af927d1 with Priority: HIGHEST for action port [ 1000.420324] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_rules [ 1000.420408] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 1000.420757] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7763fdfb-4387-462d-97c4-1daa8af927d1 with Priority: HIGHEST for action port [ 1000.421104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.421231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.421299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.421502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.421583] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.422406] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.422505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.422694] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7763fdfb-4387-462d-97c4-1daa8af927d1 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.422833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.422900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.423084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.423158] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7763fdfb-4387-462d-97c4-1daa8af927d1',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.495736] env[65231]: INFO networking_nsxv3.common.synchronization [req-1019fd26-42c5-48fd-962c-90b0ae72a272 req-ac6c0482-9339-4dea-8b61-e8dfba3ff4ca tempest-ServerRescueTestJSON-1984384378 tempest-ServerRescueTestJSON-1984384378-project-member] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 1000.496314] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 1000.496676] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.496859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.496974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.497257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.497514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.497669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.497757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.497933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.498035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.498131] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.551402] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: SUCCESS [ 1000.551620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.551778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.551987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.552536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.552741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.552970] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.555027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.637022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.925017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.925150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.927442] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7763fdfb-4387-462d-97c4-1daa8af927d1 with status ACTIVE [ 1000.927442] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.927442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.927442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.927442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.927442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.927746] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.927746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.927746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.927886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.927886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.928840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.928840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.928840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.928840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928840] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7763fdfb-4387-462d-97c4-1daa8af927d1 is going to be updated. [ 1000.954719] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.954910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.954983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.955272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.955431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.955611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7763fdfb-4387-462d-97c4-1daa8af927d1" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.000322] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.056109] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.059044] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.139022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.139022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.139022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.139022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.139022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.139022] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1001.175017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.175017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.175017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.175017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.175017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.184767] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1001.303374] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 1001.303631] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 deletion is rescheduled due to dependency. [ 1001.303705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.303907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.304706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.304706] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.304706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.304706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.305032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.305032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.305032] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.505686] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.559406] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dab779d2-9149-4b17-970e-1cc363dd590f: rpc.has_security_group_logging(os_id): False [ 1001.561666] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1001.561666] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1001.578266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.578386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.578456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.578653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.578744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.578993] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.579123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.579288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.579356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.579520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.579520] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab779d2-9149-4b17-970e-1cc363dd590f is going to be created. [ 1001.640051] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.640414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.640414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.640489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.640635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.650351] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: IN_PROGRESS for 2s [ 1001.809560] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.007554] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.007731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.007731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.008047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.008117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.008240] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 1002.037739] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.037890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.038137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.038259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.038323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.050807] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 1002.066105] env[65231]: INFO networking_nsxv3.common.synchronization [req-71dea794-fc25-49d4-871c-d2dc07fd3f9f req-dbeb993e-3299-4416-8f92-7cf788942eae tempest-ServerActionsV293TestJSON-645260172 tempest-ServerActionsV293TestJSON-645260172-project-member] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 1002.066105] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGHEST for action security_group_members [ 1002.066105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.066105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.066105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.066105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.066105] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.066105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.066498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.066498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.066498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.066654] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.312253] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.469789] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.470143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.470143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.470311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.485860] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1002.487425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.488189] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1002.527263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.527405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.527470] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.528119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.538909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.540358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1002.540358] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1002.540358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1002.569031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.569253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.569586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.569694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.569764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.570023] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.570127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.571016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.571016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.571016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.571016] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 is going to be updated. [ 1002.587420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.587420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.587420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.587810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.589226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.589457] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1002.614908] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.616123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.616123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.616123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.616123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.625226] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: IN_PROGRESS for 2s [ 1002.687069] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.687383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.687383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.688512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.688512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.688512] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1002.816052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.816319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.816413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.816716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.816832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.816888] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 1002.848427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.848742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.848939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.851081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.851081] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.851081] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1002.851081] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ef5784cc-7357-491d-87fc-9e86cfa66f0a', '46aaaa81-68ab-4e7d-baa6-29897d6cee13', '45d0c669-d29b-4033-86e4-fdbf9e070f07', '8484bf59-35bd-4576-8ebe-fc2e1520b057', '1c9ba1c5-13c5-4d83-8ace-73ea7d651451', 'bcecc58c-6471-4f02-a7e2-fe8324893375', '07ae4197-f0b5-42cc-83f2-b8f0bb199776', '3a77ea6c-8279-4404-bdc2-a6401a557a16', '17657ce0-a2c9-466c-a6c4-c2a07aab6fd0', '848d2bc8-86fa-42f2-8986-0a1fae12ae1b', 'cb52a7d4-b318-4846-9f1c-63a06c5cba5a', 'c15aec1a-6b31-4260-9fa5-1dd741dd95c5', 'e84a3002-4115-443b-93ae-8ea2f36a04a2', '86b6679c-89d1-48f3-bc4c-125e7f8f71df', '1e382486-015d-44b8-a3e5-a0f228b61242', '66402614-4b09-43ce-b9ff-d784c9639b26', 'cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3', '1f698486-5433-4f5d-838f-8989284e2ed7', '93d71ddd-aafd-4027-b22a-d8863fc345e7', '43373c35-f1da-468d-a81a-368c06b022b4', '869acb51-f00a-446a-b29b-f2bb797e9d19', 'd76eb4ea-4e07-4f87-8e4f-58cae3b3eccd', '01960bce-f3a7-4830-a96e-89dc3cc30754', 'dab779d2-9149-4b17-970e-1cc363dd590f', '048f7577-8ddf-44da-9165-34de6c108c3b', '2b54578a-a5d1-4189-a2be-ff086c792902', '3effb6bd-b711-484f-a4bf-1ecdf2a28db6', '9389aaed-1ad6-48d4-af15-236c6a035cba', '089102e4-f74e-4139-88d6-a79e9f27e9c1', '66588024-bc1b-4c51-8e2d-4b20cabf9055', 'a7635576-86a3-4c1e-879c-905a9e43f478', 'f59524d0-6c69-4693-8189-3ea92184056b', 'e78acfd0-0636-44da-8f92-638d0b04c956', '01685928-70c6-4a4e-8584-3fbdbe9910e3', 'ee4dd131-77b2-4914-aa5f-9f4b5de030a2', 'd28923db-4093-40f3-b394-1a2f62eeee3d', '891aab68-a374-48cb-ac40-546cb8e3fe02', '1bcea4e4-2c8c-4878-89e4-515969ca794c', '86218e2b-505b-489d-9831-63e52af66c10', 'e6430736-9ff5-460b-bc23-c5a9b4bcafe0', 'c2d80f7f-757f-4f15-9618-2e66c9f29176', 'e543173b-3aa1-49c7-bec7-ab450397ef46', '815e1e30-e3ab-42b0-b86b-fcd2a81435a2', '8b152afd-9129-4bd3-b47d-6533ebe5e687', 'cee33745-1169-4666-835e-545451997389', '4930f591-dad9-4803-8936-7b21d9dabe55', 'b1183b41-14a7-418b-9e37-1cfcc5aec444', 'a3040d0e-55de-46b1-b5fb-234c0b6b3c67', '8c7c7dcc-21d1-45b3-b34e-4d29c652aefb', 'b384100c-460b-4c13-8f1d-ec90af9ef06d', 'e07d317b-0483-4445-8dd5-93a55bfaf9ae'} {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1002.851081] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1002.854840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.855200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.855368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.856658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.856658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.868086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 1002.876584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.876834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.876926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.881024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.881024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.881024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1002.881024] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1002.881024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1002.990057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.990847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.990847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.990847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.996025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.996352] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1002.996433] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1002.996507] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1002.996573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1002.996649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1002.996768] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 1002.996826] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGH for action security_group_rules [ 1002.996865] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGH for action security_group_rules [ 1002.996931] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGH for action security_group_rules [ 1002.996978] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGH for action security_group_rules [ 1002.997132] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGH for action security_group_rules [ 1002.997226] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 1002.997322] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGH for action security_group_rules [ 1002.997424] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGH for action security_group_rules [ 1002.997498] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGH for action security_group_rules [ 1002.997567] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGH for action security_group_rules [ 1002.997648] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGH for action security_group_rules [ 1002.997711] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 1002.997782] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGH for action security_group_rules [ 1002.997903] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGH for action security_group_rules [ 1002.997999] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGH for action security_group_rules [ 1002.998082] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGH for action security_group_rules [ 1002.998165] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 1002.998262] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGH for action security_group_rules [ 1002.998334] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGH for action security_group_rules [ 1002.998459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.197137] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1003.197469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.474978] env[65231]: INFO networking_nsxv3.common.synchronization [req-57a57cf5-4a0f-4c22-aa46-433b1b58d7e2 req-5f663666-562c-4490-98b0-90d6baa45c35 tempest-ServersNegativeTestJSON-1310562200 tempest-ServersNegativeTestJSON-1310562200-project-member] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1003.475561] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1003.475709] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 1003.475812] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGH for action security_group_rules [ 1003.475913] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 1003.476013] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGH for action security_group_rules [ 1003.476206] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGH for action security_group_rules [ 1003.476331] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 with Priority: HIGH for action security_group_rules [ 1003.476503] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 1003.476704] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 with Priority: HIGH for action security_group_rules [ 1003.476833] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df with Priority: HIGH for action security_group_rules [ 1003.476950] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66402614-4b09-43ce-b9ff-d784c9639b26 with Priority: HIGH for action security_group_rules [ 1003.477076] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 1003.477200] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 with Priority: HIGH for action security_group_rules [ 1003.477325] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a with Priority: HIGH for action security_group_rules [ 1003.477434] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b with Priority: HIGH for action security_group_rules [ 1003.477596] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 with Priority: HIGH for action security_group_rules [ 1003.477828] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGH for action security_group_rules [ 1003.477984] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGH for action security_group_rules [ 1003.478118] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 with Priority: HIGH for action security_group_rules [ 1003.478243] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGH for action security_group_rules [ 1003.478334] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 with Priority: HIGH for action security_group_rules [ 1003.478742] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.478897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.478966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.479186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.479389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.479519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.479597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.479753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.479886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.480039] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.481620] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.481783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.481874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.483100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.483100] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.484291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.484498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.484963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.485062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.485239] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.486216] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.486322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.486665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.486665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.486665] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.487600] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.487725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.487800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.488412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.488567] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.489894] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.489894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.489894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.489894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.489894] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.490501] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d71ddd-aafd-4027-b22a-d8863fc345e7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.490603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.490663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.490822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.490885] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d71ddd-aafd-4027-b22a-d8863fc345e7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.493320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.493431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.493496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.493728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.493802] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.496007] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.496106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.496174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.496539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.496664] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.497600] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.497745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.498190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.498190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.498480] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b6679c-89d1-48f3-bc4c-125e7f8f71df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.499244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66402614-4b09-43ce-b9ff-d784c9639b26 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.499396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.499493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.499661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.499757] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66402614-4b09-43ce-b9ff-d784c9639b26',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.500578] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.502230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.502303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.504787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.504787] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.505565] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.505565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.505565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.505565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.505565] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c15aec1a-6b31-4260-9fa5-1dd741dd95c5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.508243] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.508243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.508243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.508243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.508243] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb52a7d4-b318-4846-9f1c-63a06c5cba5a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.509533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.509692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.509784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.510162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.510162] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d2bc8-86fa-42f2-8986-0a1fae12ae1b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.513900] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.514065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.514221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.514595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.514595] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17657ce0-a2c9-466c-a6c4-c2a07aab6fd0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.515862] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.516026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.516089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.516244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.516319] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.517725] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.517825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9ba1c5-13c5-4d83-8ace-73ea7d651451',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.521354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8484bf59-35bd-4576-8ebe-fc2e1520b057 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.521354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.523658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.523658] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8484bf59-35bd-4576-8ebe-fc2e1520b057',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.525915] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.665086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: SUCCESS [ 1003.665387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.859702] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.860089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.860089] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.860294] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.860547] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.860723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.860845] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.861078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.861223] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.861431] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.861542] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.861648] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.861753] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.861860] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.861966] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.862104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.880920] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.881113] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.881251] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.881428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.881735] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3def3191-542a-4742-b4e3-ba21b10b348d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.882261] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.882261] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.882392] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.882502] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3def3191-542a-4742-b4e3-ba21b10b348d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.018848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.019136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.019136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.019401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.019647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.019772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.019839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.020086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.020222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.020333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.020428] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.024443] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.024443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.024443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.024443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.024628] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.024681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.024725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.024846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.025248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.025248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.025248] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.027987] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.028132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.028178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.028359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.028522] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.028619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.028681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.028826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.028908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.029036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.029183] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.031190] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.031307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.033422] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.033537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.035091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.035241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.035315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.035447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.035593] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.035710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.035778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.035934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.036017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.036106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.036200] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.044038] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.044211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.044262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.044439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.044602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.044741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.044812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.044966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.045065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.045150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.045238] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.046177] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.046282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.047197] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.047197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.047590] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.050430] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.058699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.058699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.058699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.059082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.059082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.059082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.059082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.059216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.059315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.059442] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.059534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.059596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.060181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.060181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.060181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.060181] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.062952] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.063090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.063187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.063848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.063848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.063977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.063977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.064128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.064203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.064285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.064426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.064642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.064642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.064804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.064838] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.065139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.065139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.065139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.065270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.065308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.065367] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.076014] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 1004.100125] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.100125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.100125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.100427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.112291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 1004.112528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.113112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.113329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.113523] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.113640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.113706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.113902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.113989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.114094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.114186] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.117420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.118063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.120218] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.120332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.121372] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.121466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.122712] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.125053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.125843] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.126592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.127041] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.127138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.127774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.127876] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9ba1c5-13c5-4d83-8ace-73ea7d651451 is going to be deleted. [ 1004.129295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.129409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.129456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.129631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.131587] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.131684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.133260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.133374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.134340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.134340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.135541] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1004.136032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.136135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.139921] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1004.140351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.140485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.154088] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1004.155391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.155391] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c15aec1a-6b31-4260-9fa5-1dd741dd95c5 is going to be deleted. [ 1004.155855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.156160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.177852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.177852] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb52a7d4-b318-4846-9f1c-63a06c5cba5a is going to be deleted. [ 1004.177852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.177852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.197324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.197324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.199645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.199776] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be deleted. [ 1004.200999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.201160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.227374] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.227569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.229140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.229585] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b6679c-89d1-48f3-bc4c-125e7f8f71df is going to be deleted. [ 1004.230545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.230646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.243418] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.243418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.254912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.254912] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3 is going to be deleted. [ 1004.255863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.256119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.298600] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.298767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.314161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.314293] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66402614-4b09-43ce-b9ff-d784c9639b26 is going to be deleted. [ 1004.315420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.315761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.352214] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.352327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.386465] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.386465] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.386465] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.386465] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.386781] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.386781] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3def3191-542a-4742-b4e3-ba21b10b348d not found, creating... [ 1004.387052] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.387470] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.387470] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.387621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.387753] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.389114] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.389114] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.389114] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.389114] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.389114] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.389114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3def3191-542a-4742-b4e3-ba21b10b348d is going to be created. [ 1004.413536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.415028] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d2bc8-86fa-42f2-8986-0a1fae12ae1b is going to be deleted. [ 1004.415937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.415937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.440975] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.441107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.477507] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.478154] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.478154] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.478438] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.478931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.479028] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.481019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.481019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.493257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.493481] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be deleted. [ 1004.496680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.496919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.523188] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.531444] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.541301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.541301] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d71ddd-aafd-4027-b22a-d8863fc345e7 is going to be deleted. [ 1004.542822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.543189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.556841] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.563608] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.565109] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.565266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.565339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.565553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.565646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.565746] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1004.578826] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 1004.621666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.622639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.622639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.622639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.622639] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.622891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.622944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.623158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.623526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.624557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.624828] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.625587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.625587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.625587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.625758] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.626101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.626101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.626308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.626433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.626549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.626684] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.795636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.795636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8484bf59-35bd-4576-8ebe-fc2e1520b057 is going to be deleted. [ 1004.796831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.797127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.823285] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b54578a-a5d1-4189-a2be-ff086c792902 in Status: SUCCESS [ 1004.823487] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 deletion is rescheduled due to dependency. [ 1004.823605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.831065] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.831279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.852229] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.852371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.858720] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.858720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.868249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.868612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.877528] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.877724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.877770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.877963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.878200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.882602] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 1004.882882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.883077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.884982] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.884982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.884982] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.887857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.887987] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17657ce0-a2c9-466c-a6c4-c2a07aab6fd0 is going to be deleted. [ 1004.889659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.889659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.891961] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1004.973419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.973671] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.973790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.973905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.974072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.974160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.974371] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.974477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.974531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.974713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.974813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.974937] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.975021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.975104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.975252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.975331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.975426] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9ba1c5-13c5-4d83-8ace-73ea7d651451" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c15aec1a-6b31-4260-9fa5-1dd741dd95c5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb52a7d4-b318-4846-9f1c-63a06c5cba5a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.979072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.980342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.980342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b6679c-89d1-48f3-bc4c-125e7f8f71df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.980493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.980493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66402614-4b09-43ce-b9ff-d784c9639b26" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.980734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.980835] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.980918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.981032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb5c6c0c-ae6d-4378-8c59-6ec7c1acbce3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.981144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.981277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.025070] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcecc58c-6471-4f02-a7e2-fe8324893375: rpc.has_security_group_logging(os_id): False [ 1005.030089] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.030293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.035159] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 1005.058155] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a77ea6c-8279-4404-bdc2-a6401a557a16: rpc.has_security_group_logging(os_id): False [ 1005.069463] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46aaaa81-68ab-4e7d-baa6-29897d6cee13: rpc.has_security_group_logging(os_id): False [ 1005.071876] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.072114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.104320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.104642] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.104800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.104884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.105420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.105527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.105769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.105888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.105948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.106162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.106250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.106479] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.106674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.106757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.106927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.107027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.107142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1005.108386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.108629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.108693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.108797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d2bc8-86fa-42f2-8986-0a1fae12ae1b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.108945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.109132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.109211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.109329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.110200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.110313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.110393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.110569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.110704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.110909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17657ce0-a2c9-466c-a6c4-c2a07aab6fd0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.111058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.111227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.111316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.111436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d71ddd-aafd-4027-b22a-d8863fc345e7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.111575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.111733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.111830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.111976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8484bf59-35bd-4576-8ebe-fc2e1520b057" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.112664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.112952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.132609] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43373c35-f1da-468d-a81a-368c06b022b4: rpc.has_security_group_logging(os_id): False [ 1005.132819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.132939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.134367] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.134367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.144282] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.144435] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.186839] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.186839] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [req-57a57cf5-4a0f-4c22-aa46-433b1b58d7e2 req-2d97176f-2cbc-4790-9ebb-e62e2f2e654e service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [req-57a57cf5-4a0f-4c22-aa46-433b1b58d7e2 req-2d97176f-2cbc-4790-9ebb-e62e2f2e654e service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [req-57a57cf5-4a0f-4c22-aa46-433b1b58d7e2 req-2d97176f-2cbc-4790-9ebb-e62e2f2e654e service nova] Enqueued Resource ID: 3def3191-542a-4742-b4e3-ba21b10b348d with Priority: HIGHEST for action port [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1005.232416] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3def3191-542a-4742-b4e3-ba21b10b348d with Priority: HIGHEST for action port [ 1005.233021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.233326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.233675] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.233895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.234409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3def3191-542a-4742-b4e3-ba21b10b348d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.235020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.235220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.235528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.235729] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3def3191-542a-4742-b4e3-ba21b10b348d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.245621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.245945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.246056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.246119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.246325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.246405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.246498] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 is going to be updated. [ 1005.249154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.250366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.255316] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.255521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.309026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.309026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.309026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.309026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.309026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.309026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.309026] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1005.310464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.310830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.359102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.359528] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.359646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.359731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.359991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.360116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.360224] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1005.362025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.362245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.365256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.366276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.390290] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.391055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.391205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.391463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.391708] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.392196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.392196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.392471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.392570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.392685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.392928] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.393054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.393112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.393569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.394183] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.394330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.394402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.394553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.394635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.394720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.394810] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.403815] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.404017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.414975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.415344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.415462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.415532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.415739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.415826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.415922] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 is going to be updated. [ 1005.417210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.417440] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.474884] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.475133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.489241] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.489388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.491746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.492019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.492158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.492802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.492802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.492802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.492802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.493055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.493055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.493130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.493165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.493324] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.493402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.494111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.494111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.494111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.494111] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 1005.494917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.495090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.495228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.500098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.500222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.542646] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1005.544660] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: IN_PROGRESS for 2s [ 1005.552567] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1005.553609] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1005.593259] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1005.607167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.609871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.610021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.610295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.610479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.634506] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: IN_PROGRESS for 2s [ 1005.739424] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3def3191-542a-4742-b4e3-ba21b10b348d with status ACTIVE [ 1005.739679] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.740010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.740010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.740316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.740399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.740825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.740825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.740825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.740994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.741043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.742365] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.742365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.742365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.742365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.742789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.742789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3def3191-542a-4742-b4e3-ba21b10b348d is going to be updated. [ 1005.744734] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.744857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.744924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.745665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.745665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.794956] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.795202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.795329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.795548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.795683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.795849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3def3191-542a-4742-b4e3-ba21b10b348d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.809881] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.810512] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 1005.899649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e543173b-3aa1-49c7-bec7-ab450397ef46: rpc.has_security_group_logging(os_id): False [ 1005.939212] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.939212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.939212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.939212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.972172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.972172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.972172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.972172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.972702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.972702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.972702] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 1006.067636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.067810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.067871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.068086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.068278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.086483] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 1006.903023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1006.903023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.903023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.904430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.904680] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.904851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.904933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.905181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.905296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.905416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.905583] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.906550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.906783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.907572] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.907572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.907572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.907572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.907572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.907572] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.410040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.410257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.410477] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.559705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1007.559982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.560735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: SUCCESS [ 1007.560935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.569023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1007.569023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.569023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1007.569023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.613840] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1007.614178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.650055] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: SUCCESS [ 1007.651162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.826377] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 1007.826609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.913772] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.969289] env[65231]: INFO networking_nsxv3.common.synchronization [req-90ce6472-d05a-4840-8b12-2a3348f5d2cb req-1da4d468-f4c2-4720-8c03-57e2a20069bc tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1007.969289] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1007.969289] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.969289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.969289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.969289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.970034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.970399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.970564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.971063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.971268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.971643] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.103565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 1008.104520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.416529] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.416751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.416885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.417153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.417294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.417452] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1008.448187] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.448335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.448491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.448619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.448762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.463988] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1008.474488] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.492711] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.492953] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.493098] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.493385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.495233] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.495233] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.495370] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.495525] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.495675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.495876] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.495991] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.496118] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.496221] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.496327] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.496424] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.496554] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.518759] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.518759] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.518759] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.520638] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.521028] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.521266] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.521405] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.522111] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.522111] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d3c7d9-41c0-4b13-a46e-26101cb856cc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.832543] env[65231]: INFO networking_nsxv3.common.synchronization [None req-7aa9126c-a587-4e35-b385-e2ee534ed02f None None] Enqueued Resource ID: c1bab074-dbed-4289-b468-4e81ddc17685 with Priority: HIGHEST for action port [ 1008.833768] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1bab074-dbed-4289-b468-4e81ddc17685 with Priority: HIGHEST for action port [ 1008.834117] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1bab074-dbed-4289-b468-4e81ddc17685 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.834238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1bab074-dbed-4289-b468-4e81ddc17685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.834332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1bab074-dbed-4289-b468-4e81ddc17685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.834622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1bab074-dbed-4289-b468-4e81ddc17685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.834946] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1bab074-dbed-4289-b468-4e81ddc17685',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.979892] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.025611] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.025839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.025985] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.026385] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.026615] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.026837] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port e6d3c7d9-41c0-4b13-a46e-26101cb856cc not found, creating... [ 1009.027252] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.027576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.027729] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.028073] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.028253] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.028682] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.029354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.029519] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.029754] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.029918] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.030136] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: e6d3c7d9-41c0-4b13-a46e-26101cb856cc is going to be created. [ 1009.056025] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.056025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.056025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.056025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.056025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.056025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.337119] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1bab074-dbed-4289-b468-4e81ddc17685 [ 1009.337359] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.337504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.337575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.337818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.337960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.338147] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1bab074-dbed-4289-b468-4e81ddc17685 already deleted. [ 1009.338387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1bab074-dbed-4289-b468-4e81ddc17685" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.482426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.482588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.482662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.484823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.484823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.484823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be updated. [ 1009.524670] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.524670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.524670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.524670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.524670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.533748] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 1009.814766] env[65231]: INFO networking_nsxv3.common.synchronization [req-90ce6472-d05a-4840-8b12-2a3348f5d2cb req-b29a3a52-948d-4251-937a-f103cea50c64 service nova] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 1009.814952] env[65231]: INFO networking_nsxv3.common.synchronization [req-90ce6472-d05a-4840-8b12-2a3348f5d2cb req-b29a3a52-948d-4251-937a-f103cea50c64 service nova] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1009.815107] env[65231]: INFO networking_nsxv3.common.synchronization [req-90ce6472-d05a-4840-8b12-2a3348f5d2cb req-b29a3a52-948d-4251-937a-f103cea50c64 service nova] Enqueued Resource ID: e6d3c7d9-41c0-4b13-a46e-26101cb856cc with Priority: HIGHEST for action port [ 1009.815611] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_rules [ 1009.815746] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1009.815842] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d3c7d9-41c0-4b13-a46e-26101cb856cc with Priority: HIGHEST for action port [ 1009.817314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.817478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.817548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.817753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.817835] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.820466] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.820555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.820736] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.820841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.820905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.821112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.821195] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d3c7d9-41c0-4b13-a46e-26101cb856cc',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.247047] env[65231]: INFO networking_nsxv3.common.synchronization [req-c7430e61-850b-465d-86d5-b2e8431cf54a req-6a8aa36b-13bf-4d47-857b-ca0f3008bb87 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1010.247047] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1010.247047] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.247047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.247047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.247047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.247630] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.247630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.247630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.247630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.247630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.247630] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.321658] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.322228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.322572] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6d3c7d9-41c0-4b13-a46e-26101cb856cc with status ACTIVE [ 1010.322878] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.323400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.323620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.326030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.326030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.326030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.326030] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6d3c7d9-41c0-4b13-a46e-26101cb856cc is going to be updated. [ 1010.355916] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.355916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.355916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.355916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.355916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.355916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6d3c7d9-41c0-4b13-a46e-26101cb856cc" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.452359] env[65231]: INFO networking_nsxv3.common.synchronization [None req-15330200-8102-4c55-a4db-cf107c21b50b None None] Enqueued Resource ID: 571cd700-87ce-4295-a085-88b08ab2def6 with Priority: HIGHEST for action port [ 1010.452359] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 571cd700-87ce-4295-a085-88b08ab2def6 with Priority: HIGHEST for action port [ 1010.452359] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-571cd700-87ce-4295-a085-88b08ab2def6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.452359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-571cd700-87ce-4295-a085-88b08ab2def6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.452359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-571cd700-87ce-4295-a085-88b08ab2def6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.452359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-571cd700-87ce-4295-a085-88b08ab2def6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.452359] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571cd700-87ce-4295-a085-88b08ab2def6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.477123] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.477123] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.477123] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.477123] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.477123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.478093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.478601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.478601] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.753893] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.754212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.754331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.754614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.776468] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.776468] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.776663] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.777034] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.777034] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.777194] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.777387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.778658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.778658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.778658] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.780063] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.780063] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.780063] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.780063] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.781462] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.781462] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.792169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.792430] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.792540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.792608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.792810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.792957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.793063] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1010.806198] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.806198] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.806198] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.806198] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.806198] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.806198] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.806198] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.806492] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.806492] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf1ad05-52a5-46f3-9fbf-307405e3f47f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.821455] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.821625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.821625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.822015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.822015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.831583] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1010.957787] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 571cd700-87ce-4295-a085-88b08ab2def6 [ 1010.958089] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.958264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.958361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.958628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.958760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.958892] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:571cd700-87ce-4295-a085-88b08ab2def6 already deleted. [ 1010.959011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-571cd700-87ce-4295-a085-88b08ab2def6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.980412] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d0c669-d29b-4033-86e4-fdbf9e070f07: rpc.has_security_group_logging(os_id): False [ 1011.002050] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.002272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.002386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.002702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.026902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.027247] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.027378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.027436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.027667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.027752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.027955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.028099] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.028151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.028277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.028370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.028558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.028651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.028723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.028860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.029016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.030828] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1011.102458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.102621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.102679] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.102915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.103080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.121132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1011.309312] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.309657] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.309852] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.310221] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.310420] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.310583] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 7bf1ad05-52a5-46f3-9fbf-307405e3f47f not found, creating... [ 1011.310906] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.311102] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.311224] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.311491] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.311658] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.311980] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.312355] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.312524] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.315858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.315858] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.315858] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 7bf1ad05-52a5-46f3-9fbf-307405e3f47f is going to be created. [ 1011.342854] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.345165] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.345549] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.346289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.346289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.347120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.546089] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 1011.546475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.546665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.546890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.547101] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.547230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.547298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.547462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.547551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.547641] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.056371] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [req-c7430e61-850b-465d-86d5-b2e8431cf54a req-57f04142-730a-4232-a034-82c8a156b145 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [req-c7430e61-850b-465d-86d5-b2e8431cf54a req-57f04142-730a-4232-a034-82c8a156b145 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [req-c7430e61-850b-465d-86d5-b2e8431cf54a req-57f04142-730a-4232-a034-82c8a156b145 service nova] Enqueued Resource ID: 7bf1ad05-52a5-46f3-9fbf-307405e3f47f with Priority: HIGHEST for action port [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1012.066570] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf1ad05-52a5-46f3-9fbf-307405e3f47f with Priority: HIGHEST for action port [ 1012.069817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.069817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.069928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.070118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.070194] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.072064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.072064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.072064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.072064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.072064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.072064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.072064] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf1ad05-52a5-46f3-9fbf-307405e3f47f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.559370] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.574625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.574625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.575565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bf1ad05-52a5-46f3-9fbf-307405e3f47f with status ACTIVE [ 1012.575807] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.575948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.576041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.576321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.576673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.576877] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.576977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.577048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.577209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.577288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.577465] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.577557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.577609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.578171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.578171] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.578171] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bf1ad05-52a5-46f3-9fbf-307405e3f47f is going to be updated. [ 1012.600146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.600312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.600365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.601042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.601042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.601042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf1ad05-52a5-46f3-9fbf-307405e3f47f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.843976] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1012.844286] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 1012.844371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.844918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.845148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.845380] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.845516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.845606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.845798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.845899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.845998] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.953698] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9b0928cc-dfd5-4d46-8b55-bd56ca543e86 None None] Enqueued Resource ID: 71317281-e4ef-4de1-844c-43961f9ba871 with Priority: HIGHEST for action port [ 1012.954751] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71317281-e4ef-4de1-844c-43961f9ba871 with Priority: HIGHEST for action port [ 1012.955601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-71317281-e4ef-4de1-844c-43961f9ba871 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.955816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71317281-e4ef-4de1-844c-43961f9ba871" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.957050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71317281-e4ef-4de1-844c-43961f9ba871" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.957050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71317281-e4ef-4de1-844c-43961f9ba871" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.957050] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71317281-e4ef-4de1-844c-43961f9ba871',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.067112] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.067112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.067112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.067112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.067112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.067112] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be updated. [ 1013.099046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.099175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.099175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.099376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.099574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.109366] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 1013.136174] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1013.141746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.141746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.141746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.141746] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.349203] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.411772] env[65231]: INFO networking_nsxv3.common.synchronization [None req-681d4eac-bc05-4645-ad0a-978545f9da70 None None] Enqueued Resource ID: 34dfb6e1-b4c3-4371-b4b5-70c4dc839df6 with Priority: HIGHEST for action port [ 1013.412549] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34dfb6e1-b4c3-4371-b4b5-70c4dc839df6 with Priority: HIGHEST for action port [ 1013.412894] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-34dfb6e1-b4c3-4371-b4b5-70c4dc839df6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.413010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34dfb6e1-b4c3-4371-b4b5-70c4dc839df6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.414337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34dfb6e1-b4c3-4371-b4b5-70c4dc839df6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.414683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34dfb6e1-b4c3-4371-b4b5-70c4dc839df6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.414683] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34dfb6e1-b4c3-4371-b4b5-70c4dc839df6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.459446] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71317281-e4ef-4de1-844c-43961f9ba871 [ 1013.459881] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.460566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.460566] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.461695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.461695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.461695] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71317281-e4ef-4de1-844c-43961f9ba871 already deleted. [ 1013.461695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71317281-e4ef-4de1-844c-43961f9ba871" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.648672] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.648945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.648945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.649176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.649357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.649529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.649529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.649652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.649736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.649819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.649912] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.661071] env[65231]: INFO networking_nsxv3.common.synchronization [req-520e0413-bf3b-4653-880a-8db64e433f1a req-7ad22504-be77-4c5b-8c00-ffb33fbe2ec6 tempest-ImagesOneServerNegativeTestJSON-1085107641 tempest-ImagesOneServerNegativeTestJSON-1085107641-project-member] Enqueued Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 1013.661417] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e543173b-3aa1-49c7-bec7-ab450397ef46 with Priority: HIGHEST for action security_group_members [ 1013.662035] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e543173b-3aa1-49c7-bec7-ab450397ef46 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.662035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.662035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.662248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.662248] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.662824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.662824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.662824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.662824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.662824] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e543173b-3aa1-49c7-bec7-ab450397ef46',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.855074] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.918700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34dfb6e1-b4c3-4371-b4b5-70c4dc839df6 [ 1013.918955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.919135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.919188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.920394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.920394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.920394] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34dfb6e1-b4c3-4371-b4b5-70c4dc839df6 already deleted. [ 1013.920394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34dfb6e1-b4c3-4371-b4b5-70c4dc839df6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.154459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.154758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.154890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.156067] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.156067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.157136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.157136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.157136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.157512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.157512] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.165737] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.166421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.166704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.167191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.167475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.167945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.169088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.169088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.169088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.169088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.170493] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 is going to be updated. [ 1014.263929] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.264304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.264375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.264731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.264989] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.284734] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: IN_PROGRESS for 2s [ 1014.357433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.357736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.358754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.358754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.358754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.358754] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1014.406232] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.406232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.406232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.406232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.406232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.417838] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1014.660323] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d0c669-d29b-4033-86e4-fdbf9e070f07: rpc.has_security_group_logging(os_id): False [ 1014.690198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.692542] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.692542] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.692542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.693891] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.694048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.694118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.694277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.694355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.694443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1014.810038] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.810038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.810038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.813101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.813521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.830142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1015.121693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 1015.122073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.122418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.122624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.123698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.123864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.123952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.126250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.126250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.126250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.126250] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.629344] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.959070] env[65231]: INFO networking_nsxv3.common.synchronization [req-a1bd9c29-3937-4624-ab9c-8145c4a9ae45 req-4fb72632-8d08-4f65-a5ce-a6c64a5317d4 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1015.959643] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1015.959961] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.960542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.960649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.960907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.961122] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.961248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.962186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.962186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.962186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.962186] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.131440] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7635576-86a3-4c1e-879c-905a9e43f478: rpc.has_security_group_logging(os_id): False [ 1016.151784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.152124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.152304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.152605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.174813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.175151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.175297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.175373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.175585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.175669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.175802] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be updated. [ 1016.255848] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.256043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.256093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.256996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.256996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.284425] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 1016.296689] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e543173b-3aa1-49c7-bec7-ab450397ef46 in Status: SUCCESS [ 1016.296965] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e543173b-3aa1-49c7-bec7-ab450397ef46 deletion is rescheduled due to dependency. [ 1016.297049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e543173b-3aa1-49c7-bec7-ab450397ef46" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.428335] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1016.428560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.428917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.429020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.429279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.429279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.429413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.430056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.430056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.430056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.430056] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.465755] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.465956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.466011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.466429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.466626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.466739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.466813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466970] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.467064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.467170] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1016.502341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.502519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.502519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.502718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.502857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.515586] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1016.845344] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1016.845590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.932340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.933389] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.933570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.934085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.934368] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.934505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.934585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.934923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.935121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.935297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.935510] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.935654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.935750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.935956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.936153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.936281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.936379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.936582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.936696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.936802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.936934] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.439314] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d80f7f-757f-4f15-9618-2e66c9f29176: rpc.has_security_group_logging(os_id): False [ 1017.457794] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.458057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.458057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.458228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.458340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.458547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.458649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.458711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.458867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.458944] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.459148] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.459242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.459306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.459446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.459520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.459718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.459807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.459868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.460010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.460093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.460176] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1017.527027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.527183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.527183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.527386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.527751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.542518] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1018.306477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 1018.306781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.381943] env[65231]: INFO networking_nsxv3.common.synchronization [req-a02bb3f1-f80f-414c-a805-178056a0364c req-4e896574-3fa0-46bf-92b4-9c265242ee10 tempest-ServersNegativeTestJSON-1310562200 tempest-ServersNegativeTestJSON-1310562200-project-member] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1018.382625] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1018.382810] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.382931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.383131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.383361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.383528] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.383629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.383692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.384262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.384262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.386021] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.527047] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1018.527442] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 1018.527442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.886690] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.390217] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.564368] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1019.564735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.891579] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.892178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.892178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.892178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.892178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.892397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1019.923326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.923491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.923582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.924068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.924068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.936189] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1020.532868] env[65231]: INFO networking_nsxv3.common.synchronization [req-83d82e60-2e11-4e0c-ba57-bbd56736125e req-12b75e92-94d7-4304-a774-8c5576db10e9 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1020.536580] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1020.536580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.536580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.536580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.536580] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.736149] env[65231]: INFO networking_nsxv3.common.synchronization [None req-883943e7-0262-4f9e-90c1-5e14b4139302 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1020.736541] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1020.736596] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.736672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.738302] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.738302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.738302] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.041349] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.243516] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.243516] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.243516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.243516] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be deleted. [ 1021.275039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.275039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.275039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.275039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.275039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.275039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.544449] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.947768] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1021.947986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.046645] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.049142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.049142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.049142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.049142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.049142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1022.081873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.082073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.082120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.082336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.082488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.092897] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1022.854232] env[65231]: INFO networking_nsxv3.common.synchronization [req-8ce67f16-aee1-4a7d-a5e5-cae16cc370a4 req-81bada4f-80ca-47e7-a6d2-84f5d8f7ee31 tempest-ServerRescueTestJSON-1984384378 tempest-ServerRescueTestJSON-1984384378-project-member] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 1022.854616] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGHEST for action security_group_members [ 1022.854958] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.855084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.855145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.855368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.855992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.856115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.856175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.856422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.856476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.856546] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.358514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.358848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.358848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.359663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.359663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.359663] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.359888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.359888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.360272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.360402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.360531] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be updated. [ 1023.390224] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.390224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.390224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.390224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.390454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.399944] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: IN_PROGRESS for 2s [ 1024.103061] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1024.103324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.590025] env[65231]: INFO networking_nsxv3.common.synchronization [req-db2a6b0f-5517-49cd-9fa3-76e6a5be0b0e req-01692463-c599-4295-8e23-b5becaf8211a tempest-ServersNegativeTestMultiTenantJSON-1561675226 tempest-ServersNegativeTestMultiTenantJSON-1561675226-project-member] Enqueued Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1024.591116] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1024.591607] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.591849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.591960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.592330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.592571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.592760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.592851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.593469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.593582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.593754] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.934863] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-928 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.935086] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-928" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.935217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-928" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.935544] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-928" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.935805] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.935958] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.936091] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.936313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.936458] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.936664] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.936775] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.936882] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.936980] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.937112] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.937218] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.937349] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.959237] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.959455] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.959560] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.959737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-928" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.960083] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-b0ab510c-e961-4372-8c21-ea4c8d227ada taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.960264] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.960388] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.960745] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.960881] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ab510c-e961-4372-8c21-ea4c8d227ada',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.097866] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.097866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.097866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.097866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.098278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.098278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.098421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.098556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.098726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.098782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.098956] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf already deleted. [ 1025.098956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.412380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43373c35-f1da-468d-a81a-368c06b022b4 in Status: SUCCESS [ 1025.412605] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 deletion is rescheduled due to dependency. [ 1025.412731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.463897] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.464209] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.464277] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.464538] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.464682] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.464836] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port b0ab510c-e961-4372-8c21-ea4c8d227ada not found, creating... [ 1025.465117] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.465279] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.465397] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.465630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.465809] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.466125] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.466282] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.466397] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.466601] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.468441] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.468441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: b0ab510c-e961-4372-8c21-ea4c8d227ada is going to be created. [ 1025.493335] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.493610] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.493773] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.494204] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.494544] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.494799] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.642510] env[65231]: INFO networking_nsxv3.common.synchronization [req-0f9e40fa-1a40-4f13-848d-6041847e6f5b req-fe19a22d-ffd1-4f5b-82d6-67f867929933 tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 1025.643059] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae with Priority: HIGHEST for action security_group_members [ 1025.643788] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e07d317b-0483-4445-8dd5-93a55bfaf9ae taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.643985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.644128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.644387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.644604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.644751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.644851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.645065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.645198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.645330] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e07d317b-0483-4445-8dd5-93a55bfaf9ae',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.149039] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.149039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.149039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.149039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.172589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.172886] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.173068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.173178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.173513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.173686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.173686] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae is going to be updated. [ 1026.206723] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.206987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.206987] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.207168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.207315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.217776] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: IN_PROGRESS for 2s [ 1026.276161] env[65231]: INFO networking_nsxv3.common.synchronization [req-db2a6b0f-5517-49cd-9fa3-76e6a5be0b0e req-d28d3f31-cf5b-4db4-b3b0-e5131fd5185e service nova] Enqueued Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_rules [ 1026.276329] env[65231]: INFO networking_nsxv3.common.synchronization [req-db2a6b0f-5517-49cd-9fa3-76e6a5be0b0e req-d28d3f31-cf5b-4db4-b3b0-e5131fd5185e service nova] Enqueued Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1026.276685] env[65231]: INFO networking_nsxv3.common.synchronization [req-db2a6b0f-5517-49cd-9fa3-76e6a5be0b0e req-d28d3f31-cf5b-4db4-b3b0-e5131fd5185e service nova] Enqueued Resource ID: b0ab510c-e961-4372-8c21-ea4c8d227ada with Priority: HIGHEST for action port [ 1026.276990] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_rules [ 1026.277143] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1026.277234] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ab510c-e961-4372-8c21-ea4c8d227ada with Priority: HIGHEST for action port [ 1026.277518] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.277635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.277701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.281020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.281020] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.286017] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.286203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.286279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.286486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.286653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.286747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.286811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.286963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.287054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.287154] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.290574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ab510c-e961-4372-8c21-ea4c8d227ada taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.290574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.290574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.290574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.290574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ab510c-e961-4372-8c21-ea4c8d227ada',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.698911] env[65231]: INFO networking_nsxv3.common.synchronization [req-b20f08a3-84f7-4cdf-921b-4712ae8c2db1 req-2e49fb5b-092f-4ee7-a287-ab43d79a41dc tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 1026.700356] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGHEST for action security_group_members [ 1026.700356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.700356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.700356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.700356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.700837] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.700837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.700837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.700837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.700837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.700837] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.790463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.790626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.790775] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.791780] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0ab510c-e961-4372-8c21-ea4c8d227ada with status ACTIVE [ 1026.791966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.792092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.792194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.792367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.792458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.792662] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.792724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.792786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.792937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.793037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.793277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.793380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.793449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.793655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.793774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.793849] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0ab510c-e961-4372-8c21-ea4c8d227ada is going to be updated. [ 1026.824188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.824501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.824501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.824616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.824737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.825324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ab510c-e961-4372-8c21-ea4c8d227ada" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.205514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.205662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.205725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.205948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.206052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.206252] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.206356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.206395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.206541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.206614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.206700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 is going to be updated. [ 1027.236390] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.236599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.236599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.236803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.236947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.246529] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: IN_PROGRESS for 2s [ 1027.295630] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.798840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.799207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.799207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.799364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.799456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.799573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf is going to be created. [ 1027.823718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.823939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.823939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.825053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.825053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.835933] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: UNINITIALIZED for 2s [ 1028.229438] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae in Status: SUCCESS [ 1028.229438] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e07d317b-0483-4445-8dd5-93a55bfaf9ae deletion is rescheduled due to dependency. [ 1028.229438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e07d317b-0483-4445-8dd5-93a55bfaf9ae" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.950507] env[65231]: INFO networking_nsxv3.common.synchronization [req-5d3871d4-14d9-4f90-9ae2-f8cf27df65f1 req-cca74115-1e24-4918-9e1f-bd30e108e345 tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1028.951088] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1028.951404] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.951530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.951598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.951892] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.952336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.952453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.952555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.952821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.953497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.953631] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.260043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 in Status: SUCCESS [ 1029.260614] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 deletion is rescheduled due to dependency. [ 1029.260836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.391020] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.391020] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.391020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.391020] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.391020] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.391020] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.391020] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.391686] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.391686] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.391686] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.414050] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.414190] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.414344] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.414540] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-567" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.414882] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-e777b957-ad45-45ca-9607-b0845d472a65 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.415072] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.415195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.415533] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.415676] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e777b957-ad45-45ca-9607-b0845d472a65',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.456634] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.456879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.456973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.457245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.457362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.457589] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.457692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.457810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.457920] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.457994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.458101] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1029.489445] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.489445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.489445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.489445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.489659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.500105] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1029.847556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: SUCCESS [ 1029.847794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.847972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.848289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.848468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.848591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.848657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.848823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.848907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.848991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.849161] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.918338] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.918713] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.918909] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.919264] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.919421] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.919606] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port e777b957-ad45-45ca-9607-b0845d472a65 not found, creating... [ 1029.920138] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.920410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.920666] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.921141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.921425] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.921973] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.922364] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.922550] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.922951] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.924043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.924043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: e777b957-ad45-45ca-9607-b0845d472a65 is going to be created. [ 1029.951552] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.952075] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.952075] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.952268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.952509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.952741] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.353267] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.353267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.353267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.353638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.353638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.353638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.353638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.353946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.353946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.353946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.354184] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.354554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.355156] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.355156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.355156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.355156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.355156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.355156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.355508] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.691697] env[65231]: INFO networking_nsxv3.common.synchronization [req-5d3871d4-14d9-4f90-9ae2-f8cf27df65f1 req-df1d9c73-951f-423e-a18e-044e038f957a service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 1030.691889] env[65231]: INFO networking_nsxv3.common.synchronization [req-5d3871d4-14d9-4f90-9ae2-f8cf27df65f1 req-df1d9c73-951f-423e-a18e-044e038f957a service nova] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1030.692303] env[65231]: INFO networking_nsxv3.common.synchronization [req-5d3871d4-14d9-4f90-9ae2-f8cf27df65f1 req-df1d9c73-951f-423e-a18e-044e038f957a service nova] Enqueued Resource ID: e777b957-ad45-45ca-9607-b0845d472a65 with Priority: HIGHEST for action port [ 1030.692648] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_rules [ 1030.692823] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1030.693086] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e777b957-ad45-45ca-9607-b0845d472a65 with Priority: HIGHEST for action port [ 1030.697286] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.697286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.697286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.697510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.697510] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.698788] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.698929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.699584] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-e777b957-ad45-45ca-9607-b0845d472a65 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.699709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.699779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.699967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.704360] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e777b957-ad45-45ca-9607-b0845d472a65',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.857717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d879c7b-7d8f-43cc-b0af-c07876f057bf: rpc.has_security_group_logging(os_id): False [ 1030.893348] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.893548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.893621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.893836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.893930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.894201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.894335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.894400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.894562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.894642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.894806] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.894914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.894969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.895123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.895191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.895554] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.895554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.895554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.895730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.895730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.895791] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf is going to be created. [ 1030.977531] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.977894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.977894] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.978213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.978410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.993206] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: IN_PROGRESS for 2s [ 1031.203918] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.203918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.204180] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e777b957-ad45-45ca-9607-b0845d472a65 with status ACTIVE [ 1031.204429] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.204607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.204656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.204865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.204951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.205209] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.205412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.205455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.206226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.206226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.206226] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.206226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.206226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.206452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.206452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.206526] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e777b957-ad45-45ca-9607-b0845d472a65 is going to be updated. [ 1031.231940] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.231940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.231940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.231940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.231940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.232253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e777b957-ad45-45ca-9607-b0845d472a65" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.515801] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1031.515801] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.515801] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.515801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.515801] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.580079] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9b450f1f-dbd4-4809-a7cc-39c564e7ffab None None] Enqueued Resource ID: 79e26835-bf6d-4f17-9de5-464f9b92b360 with Priority: HIGHEST for action port [ 1031.580625] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e26835-bf6d-4f17-9de5-464f9b92b360 with Priority: HIGHEST for action port [ 1031.580952] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-79e26835-bf6d-4f17-9de5-464f9b92b360 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.581363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79e26835-bf6d-4f17-9de5-464f9b92b360" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.581463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79e26835-bf6d-4f17-9de5-464f9b92b360" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.582254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79e26835-bf6d-4f17-9de5-464f9b92b360" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.582254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79e26835-bf6d-4f17-9de5-464f9b92b360',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.018546] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.087415] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79e26835-bf6d-4f17-9de5-464f9b92b360 [ 1032.087415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.087415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.087415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.087415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.087415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.087415] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79e26835-bf6d-4f17-9de5-464f9b92b360 already deleted. [ 1032.087415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79e26835-bf6d-4f17-9de5-464f9b92b360" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.523673] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.011504] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: SUCCESS [ 1033.011785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.027698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.028106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.028106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.028191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.028291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.028405] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1033.062844] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.062986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.063079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.063375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.063531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.074546] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1033.872446] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.872446] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.872446] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.872446] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.872446] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.872446] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.872446] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.873299] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.873299] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.873299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.893308] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.893552] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.893727] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.893931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.897751] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.897751] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.897751] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.897751] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.897751] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d60e4-a4db-4b41-b5ac-1202a5cf0ba5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.374039] env[65231]: INFO networking_nsxv3.common.synchronization [None req-18d48411-709f-40f6-8d90-bfd1fdc9d278 None None] Enqueued Resource ID: 3dbeb96e-45e1-46c5-875c-76bb9eef5188 with Priority: HIGHEST for action port [ 1034.374586] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dbeb96e-45e1-46c5-875c-76bb9eef5188 with Priority: HIGHEST for action port [ 1034.375650] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dbeb96e-45e1-46c5-875c-76bb9eef5188 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.375650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dbeb96e-45e1-46c5-875c-76bb9eef5188" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.375650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dbeb96e-45e1-46c5-875c-76bb9eef5188" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.375650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dbeb96e-45e1-46c5-875c-76bb9eef5188" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.375650] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dbeb96e-45e1-46c5-875c-76bb9eef5188',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.398995] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.399245] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.399366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.399678] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.399820] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.399972] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 not found, creating... [ 1034.400381] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.400669] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.400669] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.400879] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.401026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.401416] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.401567] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.401689] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.401894] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.402041] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.402188] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 is going to be created. [ 1034.424364] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.424770] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.424911] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.425491] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.425491] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.425807] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.880496] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dbeb96e-45e1-46c5-875c-76bb9eef5188 [ 1034.880802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.880946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.881039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.881302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.881434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.881650] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dbeb96e-45e1-46c5-875c-76bb9eef5188 already deleted. [ 1034.881650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dbeb96e-45e1-46c5-875c-76bb9eef5188" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.095574] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1035.096032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.096351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.096691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.097025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.097246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.097925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.097925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.097925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.097925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.098276] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.171677] env[65231]: INFO networking_nsxv3.common.synchronization [req-3d522aae-c693-408a-bc70-38f0dad12b34 req-4acca48e-6c6e-4131-979e-e7c8540ef6a9 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 1035.171867] env[65231]: INFO networking_nsxv3.common.synchronization [req-3d522aae-c693-408a-bc70-38f0dad12b34 req-4acca48e-6c6e-4131-979e-e7c8540ef6a9 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1035.172023] env[65231]: INFO networking_nsxv3.common.synchronization [req-3d522aae-c693-408a-bc70-38f0dad12b34 req-4acca48e-6c6e-4131-979e-e7c8540ef6a9 service nova] Enqueued Resource ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with Priority: HIGHEST for action port [ 1035.172699] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 1035.174212] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1035.174428] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with Priority: HIGHEST for action port [ 1035.174904] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.175164] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.175318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.176066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.176140] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.177392] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.177626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.177820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.178067] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.178340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.178583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.178677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.178961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.179161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.179355] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.181616] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.181837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.181948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.182312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.182408] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d60e4-a4db-4b41-b5ac-1202a5cf0ba5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.601069] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.601069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.601069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.601437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.601437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.601659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.601659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.601805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.601932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.602816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.602816] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.602816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.602816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.602816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.603189] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.603189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.603189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.603476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.603476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.603476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.603592] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.684648] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.685554] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with status ACTIVE [ 1035.685820] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.685955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.686062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.686236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.686312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.686488] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.687210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.687210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.687210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.687210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.687539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.688145] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.688257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.688609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.688737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.688878] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 is going to be updated. [ 1035.690625] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.690625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.711182] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.711406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.711484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.711691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.711836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.712069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.106947] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ae4197-f0b5-42cc-83f2-b8f0bb199776: rpc.has_security_group_logging(os_id): False [ 1036.126784] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.127106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.127182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.127411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.127526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.127766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.127846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.127898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.128066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.128143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.128326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.128420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.128473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.128610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.128682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.128860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.128950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.129010] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.129177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.129253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.129341] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1036.190502] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.190502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.190502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.190502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.190502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.191388] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.211514] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1036.694194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.694644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.694644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.694644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.694776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.694815] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 1036.721072] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.721221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.721292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.721500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.721658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.737052] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: UNINITIALIZED for 2s [ 1038.236840] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1038.236840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.747644] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 1038.747644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.747644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.748742] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.748742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.748742] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.251825] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.252183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.252183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.252373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.252541] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.252639] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.252735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.252928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.253036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.253241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.253644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.253644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.253644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.253861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.253898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.254053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.254053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.254241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.254329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.254431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.254525] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.760214] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f698486-5433-4f5d-838f-8989284e2ed7: rpc.has_security_group_logging(os_id): False [ 1039.781142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.781142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.781142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.781777] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.781777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.782754] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be created. [ 1039.848268] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.848452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.848513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.848698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.848879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.885298] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 1040.177790] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1040.177930] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1040.503576] env[65231]: INFO networking_nsxv3.common.synchronization [None req-debda21d-93f0-4632-a297-072820ca9fc7 tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1040.504333] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1040.504435] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.504523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.504591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.505033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.505033] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.653053] env[65231]: INFO networking_nsxv3.common.synchronization [None req-6bbe2841-1bc8-44d2-9a97-cda9afac534d tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1040.654378] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1040.654378] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.654378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.863784] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e196795-371b-4ada-87fd-6777533425ac req-564cfc20-c119-4b2a-898b-3cfca634ecb9 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1040.864574] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1040.864938] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.866179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.866179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.867505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.867505] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.867505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.867505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.867710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.867710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.867710] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.028704] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.028849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.028918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.029159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.029231] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.029329] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 already deleted. [ 1041.029407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.029557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.029711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.029793] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.370751] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.370751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.370751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.371129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.371129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.371129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.371248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.371248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.371530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.371530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.371763] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f already deleted. [ 1041.371763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.443179] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.445021] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.445021] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.445358] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.445393] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.445529] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.445811] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.445811] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.445943] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.446118] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.446199] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.467634] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.467846] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.468459] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.468459] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.468652] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-11316d6e-fc04-4fbb-8b1c-84eb550441a2 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.468652] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.468795] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.469124] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.469262] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11316d6e-fc04-4fbb-8b1c-84eb550441a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.551898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.552282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.552282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.552488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.552488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.552575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 already deleted. [ 1041.552668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.902654] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 1041.902957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.971517] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.971764] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.972036] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.972398] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.972580] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.972893] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 11316d6e-fc04-4fbb-8b1c-84eb550441a2 not found, creating... [ 1041.973205] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.973401] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973505] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.973731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.973873] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.974177] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.974369] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.974497] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.974904] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.975084] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.975232] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 11316d6e-fc04-4fbb-8b1c-84eb550441a2 is going to be created. [ 1041.998101] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.998101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.998101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.998101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.998101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.998101] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e196795-371b-4ada-87fd-6777533425ac req-44dfc345-9578-42a6-ad06-f102247e41b6 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e196795-371b-4ada-87fd-6777533425ac req-44dfc345-9578-42a6-ad06-f102247e41b6 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e196795-371b-4ada-87fd-6777533425ac req-44dfc345-9578-42a6-ad06-f102247e41b6 service nova] Enqueued Resource ID: 11316d6e-fc04-4fbb-8b1c-84eb550441a2 with Priority: HIGHEST for action port [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1042.713020] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11316d6e-fc04-4fbb-8b1c-84eb550441a2 with Priority: HIGHEST for action port [ 1042.713020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.716817] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.716817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.716817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.716817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.716817] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.718413] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-11316d6e-fc04-4fbb-8b1c-84eb550441a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.719034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.719034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.719034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.719034] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11316d6e-fc04-4fbb-8b1c-84eb550441a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.221279] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.221279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.221484] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.227203] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11316d6e-fc04-4fbb-8b1c-84eb550441a2 with status ACTIVE [ 1043.227203] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.227203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.227203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.227203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.227429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.227470] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.227562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.227604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.227737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.227804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.227975] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.228083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.228140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.228271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.228764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.228764] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11316d6e-fc04-4fbb-8b1c-84eb550441a2 is going to be updated. [ 1043.240052] env[65231]: INFO networking_nsxv3.common.synchronization [req-dfb458ac-0bab-402b-ac70-010d6cb5ab6b req-932e0faa-d319-4c67-8aa7-536346e47c1c tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1043.240052] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1043.240052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.240411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.240411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.240411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.240536] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.241014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.241096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.242513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.242513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.242513] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.252040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.252040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.252279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.252378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.252515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.252672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11316d6e-fc04-4fbb-8b1c-84eb550441a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.597860] env[65231]: INFO networking_nsxv3.common.synchronization [None req-94ffb37d-8e6b-4ff4-8ceb-598b25a6985c None None] Enqueued Resource ID: d7b247ba-b21f-4836-9f26-ea48d18202e8 with Priority: HIGHEST for action port [ 1043.598802] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b247ba-b21f-4836-9f26-ea48d18202e8 with Priority: HIGHEST for action port [ 1043.598802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7b247ba-b21f-4836-9f26-ea48d18202e8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.598968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7b247ba-b21f-4836-9f26-ea48d18202e8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.598968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7b247ba-b21f-4836-9f26-ea48d18202e8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.599211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7b247ba-b21f-4836-9f26-ea48d18202e8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.599300] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7b247ba-b21f-4836-9f26-ea48d18202e8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.713073] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.713364] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.713364] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.713705] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.713931] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.714100] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.715051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.715051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.715051] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.715051] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.715051] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.715051] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.715294] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.715294] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.715356] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.716314] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.726932] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.737681] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.737868] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.738016] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.738234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.738571] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.738748] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.738866] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.739396] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.739575] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.743562] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.102487] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7b247ba-b21f-4836-9f26-ea48d18202e8 [ 1044.102487] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.102487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.102487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.102487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.102487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.102487] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7b247ba-b21f-4836-9f26-ea48d18202e8 already deleted. [ 1044.102487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7b247ba-b21f-4836-9f26-ea48d18202e8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.233494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.233494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.233494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.233494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.233494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.233494] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be created. [ 1044.245521] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.245877] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.246132] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.246533] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.246747] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.246961] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 not found, creating... [ 1044.247436] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.247666] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.247838] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.248160] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.248375] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.248841] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.249076] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.249247] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.249550] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.249763] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.249969] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 is going to be created. [ 1044.252378] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.260683] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.260819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.260935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.261395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.261395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.278611] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: UNINITIALIZED for 2s [ 1044.283362] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.283682] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.283810] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.284148] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.284424] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.284765] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.754931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.755239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.756607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.756607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.756607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.756607] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1044.789208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.792020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.792020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.792020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.792020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.804119] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1045.051474] env[65231]: INFO networking_nsxv3.common.synchronization [req-dfb458ac-0bab-402b-ac70-010d6cb5ab6b req-41f81345-c7cb-4197-af26-c61f185ea167 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 1045.051474] env[65231]: INFO networking_nsxv3.common.synchronization [req-dfb458ac-0bab-402b-ac70-010d6cb5ab6b req-41f81345-c7cb-4197-af26-c61f185ea167 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1045.051474] env[65231]: INFO networking_nsxv3.common.synchronization [req-dfb458ac-0bab-402b-ac70-010d6cb5ab6b req-41f81345-c7cb-4197-af26-c61f185ea167 service nova] Enqueued Resource ID: a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 with Priority: HIGHEST for action port [ 1045.052404] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 1045.052773] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1045.052974] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 with Priority: HIGHEST for action port [ 1045.054698] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.056634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.060749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.060749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.060749] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.060749] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.060749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.061638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.061638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.061638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.062156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.062156] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.567266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.567266] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 with status ACTIVE [ 1045.567266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.567266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.567266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.567266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.567868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.567868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.567868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.567868] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.567868] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3 is going to be updated. [ 1045.596090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.596242] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.596311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.596513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.596643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.596807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f09bc7-09ba-4c4a-a3a8-0aa4847946c3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.978760] env[65231]: INFO networking_nsxv3.common.synchronization [req-002fe591-03c5-4f69-8752-51b0da4ed1c3 req-b56b9e8b-f937-4080-a5dd-8cde3e0947b4 tempest-ServersNegativeTestMultiTenantJSON-1561675226 tempest-ServersNegativeTestMultiTenantJSON-1561675226-project-member] Enqueued Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1045.981080] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGHEST for action security_group_members [ 1045.982052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.982052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.982052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.983287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.983287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.983287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.983287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.983287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.983287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.983287] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.289168] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1046.289457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.289693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.289921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.290157] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.290288] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.290379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.290587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.290682] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.290818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.290924] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.486412] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c7b17220-f734-426a-85b4-52628e246157 None None] Enqueued Resource ID: 385e62b5-1702-42af-b121-a485bb610850 with Priority: HIGHEST for action port [ 1046.486826] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.486960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.487046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.487248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.487340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.487539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.488137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.488951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.488951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.488951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.488951] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf is going to be updated. [ 1046.490304] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 385e62b5-1702-42af-b121-a485bb610850 with Priority: HIGHEST for action port [ 1046.490830] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-385e62b5-1702-42af-b121-a485bb610850 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.490960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-385e62b5-1702-42af-b121-a485bb610850" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.491041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-385e62b5-1702-42af-b121-a485bb610850" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.491246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-385e62b5-1702-42af-b121-a485bb610850" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.491327] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('385e62b5-1702-42af-b121-a485bb610850',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.522399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.522545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.522604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.522812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.522949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.534705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: IN_PROGRESS for 2s [ 1046.763757] env[65231]: INFO networking_nsxv3.common.synchronization [req-01e0282a-a7f4-4a2c-bf25-169e71b1caa9 req-8d24e62c-4bd5-4e90-b949-90b31ea9ba52 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1046.764435] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1046.764746] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.764864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.764928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.765139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.765287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.765594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.765594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.765594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.765766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.765766] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.812275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.812275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.812275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.812275] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.814051] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.814051] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.814051] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.814400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.814400] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.814475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.814506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.814697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.814780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.814877] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.994446] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 385e62b5-1702-42af-b121-a485bb610850 [ 1046.994818] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.994952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.995015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.995228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.995333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.995445] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:385e62b5-1702-42af-b121-a485bb610850 already deleted. [ 1046.995508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-385e62b5-1702-42af-b121-a485bb610850" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.249074] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.250568] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.250568] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.251239] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.251516] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.251798] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.251987] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.252349] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.252624] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.252886] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.254052] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.254052] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.254052] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.254052] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.254052] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.254052] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.267639] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.278538] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.278789] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.279108] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.279398] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.279849] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-43f330f0-5bd6-4db4-bec7-09872c27923a taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.280182] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.280291] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.280761] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.281026] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43f330f0-5bd6-4db4-bec7-09872c27923a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.305129] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1047.317634] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.338024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.338024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.338024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.338024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.342307] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.342307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.342307] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be created. [ 1047.414215] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.414378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.414505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.414742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.414932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.431308] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1047.770733] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.786192] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.786516] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.786652] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.786931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.787136] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.787310] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 43f330f0-5bd6-4db4-bec7-09872c27923a not found, creating... [ 1047.787697] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.790163] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.790163] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.790163] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 43f330f0-5bd6-4db4-bec7-09872c27923a is going to be created. [ 1047.817169] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.817394] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.817520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.817793] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.818132] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.822025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.824130] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.274122] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.274122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.274122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.274122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.274122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.274122] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1048.306014] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.306325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.306325] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.306527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.306801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.317572] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1048.326269] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.326462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.326627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.326881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.326980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.327153] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1048.355666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.355806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.355867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.356093] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.356233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.365382] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1048.545213] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf in Status: SUCCESS [ 1048.545410] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf deletion is rescheduled due to dependency. [ 1048.545508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.559474] env[65231]: INFO networking_nsxv3.common.synchronization [req-01e0282a-a7f4-4a2c-bf25-169e71b1caa9 req-bab59239-968d-4d9d-bbfd-2f02f6db3644 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1048.559474] env[65231]: INFO networking_nsxv3.common.synchronization [req-01e0282a-a7f4-4a2c-bf25-169e71b1caa9 req-bab59239-968d-4d9d-bbfd-2f02f6db3644 service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1048.559474] env[65231]: INFO networking_nsxv3.common.synchronization [req-01e0282a-a7f4-4a2c-bf25-169e71b1caa9 req-bab59239-968d-4d9d-bbfd-2f02f6db3644 service nova] Enqueued Resource ID: 43f330f0-5bd6-4db4-bec7-09872c27923a with Priority: HIGHEST for action port [ 1048.560051] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1048.560123] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1048.560394] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43f330f0-5bd6-4db4-bec7-09872c27923a with Priority: HIGHEST for action port [ 1048.560656] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.560782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.560837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.561057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.561143] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.562213] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.562213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.562512] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-43f330f0-5bd6-4db4-bec7-09872c27923a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.562662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.562732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.563390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.563390] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43f330f0-5bd6-4db4-bec7-09872c27923a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.812368] env[65231]: INFO networking_nsxv3.common.synchronization [req-e343d88d-5e03-4a07-9ea6-5a3417c6789c req-915ad305-ae47-4451-847f-e5b7afa6ee2f tempest-ServerDiskConfigTestJSON-1701979366 tempest-ServerDiskConfigTestJSON-1701979366-project-member] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1048.812965] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGHEST for action security_group_members [ 1048.813309] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.813434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.813540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.813744] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.813899] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.813997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.816514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.816514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.816814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.817084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.065461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.065633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.069150] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43f330f0-5bd6-4db4-bec7-09872c27923a with status ACTIVE [ 1049.069412] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.069517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.069583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.071703] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.071703] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.071703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.072602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.072602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.072602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.072602] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43f330f0-5bd6-4db4-bec7-09872c27923a is going to be updated. [ 1049.105775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.106095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.106095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.106394] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.106602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.106843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43f330f0-5bd6-4db4-bec7-09872c27923a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.320407] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.320733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.320733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.320952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.321057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.321263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.321368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.321465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.321943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.322121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.322284] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be updated. [ 1049.326521] env[65231]: INFO networking_nsxv3.common.synchronization [req-23107f50-ebfd-40bf-bf4e-773293cb10b1 req-420511a2-02a6-4051-b56e-fc22e755b4eb tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1049.328105] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1049.328631] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.328631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.328838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.328967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.329083] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.329191] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.329254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.329410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.329496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.329598] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.367046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.367046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.367046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.367046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.367463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.378397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: IN_PROGRESS for 2s [ 1049.445692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1049.446206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.788088] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.788363] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.788449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.788748] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.792249] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.792533] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.792669] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.792999] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.793176] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.793391] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.793583] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.793700] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.793807] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.793935] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.794059] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.794200] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.822236] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.822414] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.822551] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.822731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.823050] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-3acc647a-64b0-4f06-8184-19ec0d496be8 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.823226] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.823344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.823731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.823869] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3acc647a-64b0-4f06-8184-19ec0d496be8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.831866] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.832011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.832074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.832333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.832429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.832623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.832726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.832790] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.832964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.833054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.833142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be deleted. [ 1049.862858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.863027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.863101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.863330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.863585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.863785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.327208] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.328425] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.328918] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.329522] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.329696] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.329867] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 3acc647a-64b0-4f06-8184-19ec0d496be8 not found, creating... [ 1050.330411] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.330593] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.330720] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.333234] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.333234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.333234] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 is going to be created. [ 1050.334430] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1050.334608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.334808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.335031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.335230] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.335409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.335513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.335749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.335852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.335964] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.358227] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.358410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.358512] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.358928] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.359305] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.359683] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.378064] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1050.378443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.379181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.379503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.379793] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.379980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.380114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.380377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.380523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.380769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.380851] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.839215] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.884150] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.885727] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.885727] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.885727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.886580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.886580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.886580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.886580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.886580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.886580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.886580] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.106835] env[65231]: INFO networking_nsxv3.common.synchronization [req-23107f50-ebfd-40bf-bf4e-773293cb10b1 req-ae218172-4a4c-4985-83a0-2b9c9265f32a service nova] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_rules [ 1051.107105] env[65231]: INFO networking_nsxv3.common.synchronization [req-23107f50-ebfd-40bf-bf4e-773293cb10b1 req-ae218172-4a4c-4985-83a0-2b9c9265f32a service nova] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1051.107397] env[65231]: INFO networking_nsxv3.common.synchronization [req-23107f50-ebfd-40bf-bf4e-773293cb10b1 req-ae218172-4a4c-4985-83a0-2b9c9265f32a service nova] Enqueued Resource ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 with Priority: HIGHEST for action port [ 1051.108088] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_rules [ 1051.108389] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1051.108494] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 with Priority: HIGHEST for action port [ 1051.108830] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.108992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.109094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.109353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.109758] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.110458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.110579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.110651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.111260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.111260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.111397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.112397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.112397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.112397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.112397] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.112845] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3acc647a-64b0-4f06-8184-19ec0d496be8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.112983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.113078] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.113243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.113320] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3acc647a-64b0-4f06-8184-19ec0d496be8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.340593] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.390379] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 in Status: SUCCESS [ 1051.390379] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 deletion is rescheduled due to dependency. [ 1051.390379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.390379] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 1051.411695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.411695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.411695] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.411695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.412346] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.412709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.412709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.412709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.412842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.412876] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1051.484441] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.484635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.484704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.484928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.485131] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.504761] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1051.616959] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.616959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.616959] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.616959] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3acc647a-64b0-4f06-8184-19ec0d496be8 with status ACTIVE [ 1051.616959] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.617173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.617173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.617370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.617439] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.617711] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.617823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.618133] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.620031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.620031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.620031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.620031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.620893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.621079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.621166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.621260] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 is going to be updated. [ 1051.650355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.650355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.650355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.650355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.650355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.650355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.825422] env[65231]: INFO networking_nsxv3.common.synchronization [req-045cc665-a7d3-496d-a6eb-dbbdab1adac6 req-818a29bf-cfa7-417b-9d37-ec514f3c6655 tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1051.826500] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1051.826902] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.827088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.827201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.827480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.827673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.827807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.828204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.828437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.828565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.828699] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.844519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.844519] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.844773] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.844958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.845121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.845271] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1051.885521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.885521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.896275] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1052.127811] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.332749] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.332749] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.332749] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 already deleted. [ 1052.332749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.629389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.631856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.631856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.631856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.631856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.631856] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be created. [ 1052.658208] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.658208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.658208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.658208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.658208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.667132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: UNINITIALIZED for 2s [ 1052.966298] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.966580] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.966766] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.972217] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.972731] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.972939] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.973160] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.973493] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.973742] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.974044] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.974233] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.974381] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.974549] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.974700] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.974854] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.975274] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.997914] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.998228] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.998436] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.998668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.999116] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-244d67eb-de1a-45e5-b154-bd96f3564e79 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.999344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.999530] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.999933] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.000139] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244d67eb-de1a-45e5-b154-bd96f3564e79',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.503176] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.503496] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.503620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.503917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.504153] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.504233] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 244d67eb-de1a-45e5-b154-bd96f3564e79 not found, creating... [ 1053.504933] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.505195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.505321] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.505664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.505697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.506165] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.506312] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.506415] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.506640] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.506776] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.506918] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 is going to be created. [ 1053.536023] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.536023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.536023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.536023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.536023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.536023] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.563935] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1053.564330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.905621] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1053.906040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.906322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.906647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.906960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.907167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.907291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.907548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.907685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.907837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.908133] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.318272] env[65231]: INFO networking_nsxv3.common.synchronization [req-045cc665-a7d3-496d-a6eb-dbbdab1adac6 req-296a77bd-6634-4493-a941-bf078def6fb8 service nova] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1054.318510] env[65231]: INFO networking_nsxv3.common.synchronization [req-045cc665-a7d3-496d-a6eb-dbbdab1adac6 req-296a77bd-6634-4493-a941-bf078def6fb8 service nova] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1054.318793] env[65231]: INFO networking_nsxv3.common.synchronization [req-045cc665-a7d3-496d-a6eb-dbbdab1adac6 req-296a77bd-6634-4493-a941-bf078def6fb8 service nova] Enqueued Resource ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 with Priority: HIGHEST for action port [ 1054.319692] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1054.319829] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1054.320313] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 with Priority: HIGHEST for action port [ 1054.320850] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.321011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.321115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.321736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.321736] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.322649] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.322726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.322763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.322940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.323211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.323385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.323431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.323659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.323751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.323840] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.324905] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-244d67eb-de1a-45e5-b154-bd96f3564e79 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.325111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.325597] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.325915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.325951] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244d67eb-de1a-45e5-b154-bd96f3564e79',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.405662] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.405943] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.406080] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.406386] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.406748] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.406919] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.407068] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.407295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.407449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.407657] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.407792] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.407906] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.408061] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.408212] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.408324] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.408454] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.412246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.412369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.412495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.412621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.412804] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.412903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.412963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.413141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.413228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.413314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.413463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.413596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.413683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.413782] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.413900] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.413986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.414049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.414185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.414259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.414337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.414426] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.431944] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.432245] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.432480] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.433032] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.433240] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.433590] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.434644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.434644] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.434644] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d60e4-a4db-4b41-b5ac-1202a5cf0ba5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.680735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 1054.680735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.680735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.680842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.680974] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.681100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.681163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.681323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.681406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.681490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.681584] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.828613] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.828858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.829145] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.833383] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 244d67eb-de1a-45e5-b154-bd96f3564e79 with status ACTIVE [ 1054.833383] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.833383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.833383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.833383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.833383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.833960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.834166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.834253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.834427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.834540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.834974] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.835172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.835244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.835414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.835490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.835584] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 is going to be updated. [ 1054.858812] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.859031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.859116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.859324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.859458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.859626] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.916137] env[65231]: INFO networking_nsxv3.common.synchronization [req-45826c37-b9f6-4f7a-bc18-9f6d4b803591 req-9f810075-a04f-4a24-8ca0-91d854cb58bb tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1054.916684] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1054.917054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.917577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.917656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.917996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.918126] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.918234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.918296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.918445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.918531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.918642] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.922026] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d80f7f-757f-4f15-9618-2e66c9f29176: rpc.has_security_group_logging(os_id): False [ 1054.939782] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.939938] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.940112] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.940432] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.940610] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.941033] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.941250] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.941399] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.941695] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.941864] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.942238] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.942505] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.942564] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.942789] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.942929] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.943086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 is going to be updated. [ 1054.962280] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.962450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.962484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.962797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.962797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.963068] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.963068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.963304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.963304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.963381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.963524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.963665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.963714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.963864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.963933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.964167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.964255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.964324] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.964460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.964705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.964705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1055.003232] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.003232] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.003232] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.003485] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.003698] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.003906] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.086325] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.086808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.086934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.087151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.125560] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1055.185165] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.185445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.185445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.185699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.185877] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.188459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188459] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.333221] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.424172] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.424426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.424426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.424721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.425531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.425531] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.425531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.425531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.425531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.425531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.425794] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 already deleted. [ 1055.425794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.427867] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.428079] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.428216] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.428514] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.428845] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.429087] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.429146] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.429539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.429716] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.429995] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.430149] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.430302] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.430454] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.430656] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.430845] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.431017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.452537] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.452783] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.453384] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.453611] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.453953] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3e031f40-0466-4875-aa1f-d62d4fd0592d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.454149] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.454269] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.454656] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.454844] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e031f40-0466-4875-aa1f-d62d4fd0592d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.690155] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e382486-015d-44b8-a3e5-a0f228b61242: rpc.has_security_group_logging(os_id): False [ 1055.696936] env[65231]: INFO networking_nsxv3.common.synchronization [req-48260934-2431-4dab-8cb1-6a7568094242 req-17d86a77-4cb1-4c7f-a425-73f6b3c1adc1 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 1055.696936] env[65231]: INFO networking_nsxv3.common.synchronization [req-48260934-2431-4dab-8cb1-6a7568094242 req-17d86a77-4cb1-4c7f-a425-73f6b3c1adc1 service nova] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1055.696936] env[65231]: INFO networking_nsxv3.common.synchronization [req-48260934-2431-4dab-8cb1-6a7568094242 req-17d86a77-4cb1-4c7f-a425-73f6b3c1adc1 service nova] Enqueued Resource ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with Priority: HIGHEST for action port [ 1055.698098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_rules [ 1055.698098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1055.698098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with Priority: HIGHEST for action port [ 1055.698098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.698098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.698098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.698450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.698450] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.699153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.699275] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.699341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.699512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.699660] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.699755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.699810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.699943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.700038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.700129] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.701388] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.701388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.701517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.701708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.701887] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d60e4-a4db-4b41-b5ac-1202a5cf0ba5',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.715037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.715222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.715289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.715508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.715596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.715796] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.715924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.715982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.716220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.716327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.716662] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.719612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.719612] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.719768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.719956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.720397] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.720397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.720397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.720397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.720717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.720717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be created. [ 1055.794433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.794606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.794707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.794995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.795306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.809661] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 2s [ 1055.835571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.835858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.835926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.836226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.836362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.836499] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 is going to be created. [ 1055.869477] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.869645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.869729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.869946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.870122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.901201] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: UNINITIALIZED for 2s [ 1055.957640] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.958241] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.958241] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.958475] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.958630] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.958785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3e031f40-0466-4875-aa1f-d62d4fd0592d not found, creating... [ 1055.959083] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.959366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.959366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.959598] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.959735] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.960095] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.960239] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.960361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.960591] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.960723] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.960932] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3e031f40-0466-4875-aa1f-d62d4fd0592d is going to be created. [ 1056.002140] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.002500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.002500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.002835] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.003087] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.003327] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.144053] env[65231]: INFO networking_nsxv3.common.synchronization [req-42289b34-a298-4e29-b26e-a45a879e47fd req-dd09801b-384d-4d4b-9d66-15e246fb68e9 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1056.145028] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1056.145471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.145653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.145747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.146153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.146329] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.146486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.146653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.146810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.147727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.147727] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.204044] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.367071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.367207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.367388] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 with status ACTIVE [ 1056.367550] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.367669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.367779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.368087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.368198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.368439] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.368531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.368531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.368733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.368733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.368949] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.369060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.369120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.369280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.369364] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.369457] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 386d60e4-a4db-4b41-b5ac-1202a5cf0ba5 is going to be updated. [ 1056.398733] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.399076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.399076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.399317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.399462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.399644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-386d60e4-a4db-4b41-b5ac-1202a5cf0ba5" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.649923] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.650161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.650161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.650378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.650480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.650687] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.650791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.650870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.651070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.651185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.651288] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1056.708718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.708718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.708718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.708986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.709901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.724157] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1056.751386] env[65231]: INFO networking_nsxv3.common.synchronization [req-45826c37-b9f6-4f7a-bc18-9f6d4b803591 req-3368605e-08f9-4882-a4ad-282bcc17303e service nova] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_rules [ 1056.751630] env[65231]: INFO networking_nsxv3.common.synchronization [req-45826c37-b9f6-4f7a-bc18-9f6d4b803591 req-3368605e-08f9-4882-a4ad-282bcc17303e service nova] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1056.751843] env[65231]: INFO networking_nsxv3.common.synchronization [req-45826c37-b9f6-4f7a-bc18-9f6d4b803591 req-3368605e-08f9-4882-a4ad-282bcc17303e service nova] Enqueued Resource ID: 3e031f40-0466-4875-aa1f-d62d4fd0592d with Priority: HIGHEST for action port [ 1056.752711] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_rules [ 1056.752841] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1056.752961] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e031f40-0466-4875-aa1f-d62d4fd0592d with Priority: HIGHEST for action port [ 1056.753300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.753484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.753696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.754135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.754255] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.755434] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.755557] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.755657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.755992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.756188] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.756628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.756721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.756942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.758571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.758571] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.758571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e031f40-0466-4875-aa1f-d62d4fd0592d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.758571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.758571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.758571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.759171] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e031f40-0466-4875-aa1f-d62d4fd0592d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.871991] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.145429] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1057.145748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.263640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.264478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.264849] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.266761] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e031f40-0466-4875-aa1f-d62d4fd0592d with status ACTIVE [ 1057.267129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.267306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.267450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.267794] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.267956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.268265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.268438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.268551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.268836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.268982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.269339] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.269549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.269715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.270073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.270280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.270498] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e031f40-0466-4875-aa1f-d62d4fd0592d is going to be updated. [ 1057.302808] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.302808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.302808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.302808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.302808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.303184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e031f40-0466-4875-aa1f-d62d4fd0592d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.379024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.379024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.379024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.379024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.379024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.379024] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 1057.436922] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.437232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.437232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.437419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.437531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.453447] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 1057.774084] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.830455] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 4s [ 1057.916147] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: SUCCESS [ 1057.916424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.916677] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.917229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.917321] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.917460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.917543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.917828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.917922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.918134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.918197] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.280818] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.281233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.281233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.281233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.282077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.282077] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be created. [ 1058.315204] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.315204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.315204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.315505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.315505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.329946] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: UNINITIALIZED for 2s [ 1058.421206] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.749106] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1058.749339] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1058.749555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.928132] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d545a86-14ce-4276-b4f9-c746b41ad9f0: rpc.has_security_group_logging(os_id): False [ 1058.950815] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.950974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.951072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.951299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.951393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.951647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.951749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.951812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.951957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.952042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.952130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 is going to be created. [ 1059.027179] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.027179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.027179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.027179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.027179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.044514] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: IN_PROGRESS for 2s [ 1059.470107] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 1059.470416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.470521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.470838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.471153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.471229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.471383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.471572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.471668] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.570352] env[65231]: INFO networking_nsxv3.common.synchronization [req-7df332c0-3cd9-4393-9534-e5dc32062921 req-daa7059d-4e2d-4218-9027-f8176830b252 tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1059.571515] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1059.571881] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.571984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.851853] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 6s [ 1059.974962] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.975239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.975353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.975621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.975860] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.976064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.976224] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.980030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.980030] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.980030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.980030] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.997043] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.997043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.997043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.997043] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.997590] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.997590] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.997590] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.997818] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.997913] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.998251] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.998362] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.998467] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.998570] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.998689] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.998789] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.998916] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.027084] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.027297] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.027490] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.027762] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.028135] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.028334] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.028664] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.029012] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.029594] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.342269] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1060.342463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.342653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.342963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.343191] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.343313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.343390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.343556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.343685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.343752] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.343860] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.344886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.345097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.345295] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.345407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.345495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.345779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.345865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.345967] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.482370] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f698486-5433-4f5d-838f-8989284e2ed7: rpc.has_security_group_logging(os_id): False [ 1060.505827] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.506111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.506111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.506474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.506474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.506659] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.506792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.506859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.507046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.507136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.507330] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.507424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.507497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.507651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.507726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.507909] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.508352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.508352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.508352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.508486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.508521] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 1060.533495] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.533869] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.534028] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.534364] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.534528] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.534873] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd not found, creating... [ 1060.535352] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.535571] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.535702] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.537316] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.537316] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.537586] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd is going to be created. [ 1060.564385] env[65231]: INFO networking_nsxv3.common.synchronization [req-77ced6a3-1a69-452e-8043-26e90b2ef8fa req-ee882954-f2cd-42a5-8887-75da38598926 tempest-ServersTestFqdnHostnames-16005605 tempest-ServersTestFqdnHostnames-16005605-project-member] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 1060.565780] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.566031] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.566110] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.566387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.566618] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.566896] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.567961] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGHEST for action security_group_members [ 1060.568519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.568641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.568715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.568902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.569093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.569209] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.569267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.569429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.569510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.569604] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.592024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.592225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.592310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.592532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.592711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.617512] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 1060.849832] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.849967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.850585] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.059355] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: SUCCESS [ 1061.059592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.072286] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.072450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.072530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.072762] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.099814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100115] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.100357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100693] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab779d2-9149-4b17-970e-1cc363dd590f is going to be updated. [ 1061.135658] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.135840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.135881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.136174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.136356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.149665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: IN_PROGRESS for 2s [ 1061.303362] env[65231]: INFO networking_nsxv3.common.synchronization [req-7df332c0-3cd9-4393-9534-e5dc32062921 req-8fc618be-bfd2-4679-8134-b135ecd773ad service nova] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_rules [ 1061.303696] env[65231]: INFO networking_nsxv3.common.synchronization [req-7df332c0-3cd9-4393-9534-e5dc32062921 req-8fc618be-bfd2-4679-8134-b135ecd773ad service nova] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1061.303873] env[65231]: INFO networking_nsxv3.common.synchronization [req-7df332c0-3cd9-4393-9534-e5dc32062921 req-8fc618be-bfd2-4679-8134-b135ecd773ad service nova] Enqueued Resource ID: 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd with Priority: HIGHEST for action port [ 1061.306950] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_rules [ 1061.306950] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1061.306950] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd with Priority: HIGHEST for action port [ 1061.306950] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.306950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.306950] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.306950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.306950] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.306950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.306950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.306950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.307362] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.353024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.811114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd with status ACTIVE [ 1061.811466] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.811786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.811879] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.812349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.812349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.812592] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.812722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.812809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.813060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.813168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.813398] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.813719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.813719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.813801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.813871] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.813958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd is going to be updated. [ 1061.843133] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.843294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.843359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.843580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.843756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.843926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53ec5c97-d8b6-4bde-b223-f3fc5f02f4fd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.855865] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.855983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.856054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.857017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.857017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.857017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1061.874225] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 8s [ 1061.905129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.905336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.905336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.905547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.905692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.929899] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1062.639274] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 1062.639274] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.158546] env[65231]: INFO networking_nsxv3.common.synchronization [req-340e98c1-2196-4656-8a01-18faddea32c1 req-3df4c465-8e8d-4af9-ba47-a0fb27086454 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1063.159085] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGHEST for action security_group_members [ 1063.160336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.160336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.160336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.160336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.160336] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.160336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.160336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.160591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.160591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.160696] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.166184] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab779d2-9149-4b17-970e-1cc363dd590f in Status: SUCCESS [ 1063.166374] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab779d2-9149-4b17-970e-1cc363dd590f deletion is rescheduled due to dependency. [ 1063.166481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.207283] env[65231]: INFO networking_nsxv3.common.synchronization [req-340e98c1-2196-4656-8a01-18faddea32c1 req-3df4c465-8e8d-4af9-ba47-a0fb27086454 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 with Priority: HIGHEST for action port [ 1063.207961] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 with Priority: HIGHEST for action port [ 1063.208465] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3acc647a-64b0-4f06-8184-19ec0d496be8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.208633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.208769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.209244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.209244] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3acc647a-64b0-4f06-8184-19ec0d496be8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.669735] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.669922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.669982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.670266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.670411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.670632] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.670734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.670818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.671097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.675186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.675461] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be updated. [ 1063.711089] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3acc647a-64b0-4f06-8184-19ec0d496be8 with status ACTIVE [ 1063.711511] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.711765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.712428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.712428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.712428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.712428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.712661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.712661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.712775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.712888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.713150] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.713249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.713327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.713544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.713659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.713780] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3acc647a-64b0-4f06-8184-19ec0d496be8 is going to be updated. [ 1063.716093] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.716227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.716306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.716553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.716801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.733496] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 2s [ 1063.743817] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.744053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.744121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.744327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.744554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.744643] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3acc647a-64b0-4f06-8184-19ec0d496be8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.894824] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 10s [ 1063.946150] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1063.946150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.946332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.947315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.947315] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.947315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.947315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.947582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.947582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.947669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.948233] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.948233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.948233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.948233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.948460] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.948460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.948534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.948670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.949820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.949820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.949820] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.950376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.950615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.950814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.950930] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.951030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.952401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.952401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.952401] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.454023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2: rpc.has_security_group_logging(os_id): False [ 1064.455435] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.479154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.479154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.479154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.480480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.480605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.480840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.480945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.481027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.481205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.481299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.481477] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.481584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.482981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.482981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.482981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.483533] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.483622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.483886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.483886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.483974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.484085] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be created. [ 1064.560183] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.560391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.560431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.560624] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.560896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.575845] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1064.734016] env[65231]: INFO networking_nsxv3.common.synchronization [req-062bb409-4d49-40c5-a854-bc7ecfcce3f2 req-4b8e39ef-b60f-47bd-bcc6-1d6c96188edf tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1064.734769] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1064.737197] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.737393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.737504] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.737751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.737962] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.738152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.738241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.738424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.738534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.738661] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.966564] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.241711] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.468575] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.468949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.468949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.469178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.469316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.469486] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1065.500872] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.501180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.501180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.501381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.501514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.515976] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1065.745651] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 1065.745836] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 deletion is rescheduled due to dependency. [ 1065.745986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.748472] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.908510] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 12s [ 1066.251050] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.251050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.251258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.251397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.251502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.251624] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1066.281699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.281838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.281982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.282143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.282294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.293984] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1066.589964] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1066.590285] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.590446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.590676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.590762] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.095518] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.095675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.529908] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.533025] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.533025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.533025] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.936787] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 14s [ 1068.039061] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.039273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.039362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.041167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.041167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.041167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.041948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.041948] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.041948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.041948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.042183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.046300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.046300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.046300] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.197274] env[65231]: INFO networking_nsxv3.common.synchronization [req-7dc4dd96-2a39-4211-be6e-90bbfc0dd6e3 req-c0aa8c14-e2f1-4904-bd7c-0a7b2dccb194 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1068.197906] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1068.198368] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.198551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.198687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.198842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.199010] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.199121] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.199182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.199501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.199501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.199501] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.305733] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1068.305733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.545726] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2: rpc.has_security_group_logging(os_id): False [ 1068.570020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.570020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.570020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.570020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.570598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.570678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.570924] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.570990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.571061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.571199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.571271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.571365] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1068.651356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.654023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.654023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.654023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.654023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.666068] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1068.706031] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.065032] env[65231]: INFO networking_nsxv3.common.synchronization [req-c0b96d3f-d976-4726-a009-e2743c0470e5 req-ad809f01-aa54-4b16-970c-8b502b87ff11 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1069.065559] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1069.065884] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.066023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.066516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.066724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.066896] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.067025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.067091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.067248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.067329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.067614] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.207558] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.494552] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.494738] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.494892] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.495235] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.496066] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.496066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.496066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.496066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.496066] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.496454] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.496454] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.496535] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.496640] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.496749] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.496855] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.496987] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.516613] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.517100] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.517177] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.517395] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.517880] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-943cfd14-044c-43ae-aa38-60a9c1769c50 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.518164] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.518433] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.518986] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.519121] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943cfd14-044c-43ae-aa38-60a9c1769c50',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.571218] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.571441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.571548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.571853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.571990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.572305] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.572463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.572562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.572818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.572939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.573128] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1069.603353] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.603567] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.603673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.603982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.604217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.615391] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1069.710026] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.710237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.710282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.710481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.710584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.710688] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1069.762822] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.763076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.763076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.763210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.763358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.773716] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1069.951922] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 16s [ 1070.022648] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.022916] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.023092] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.023354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.023510] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.023669] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 943cfd14-044c-43ae-aa38-60a9c1769c50 not found, creating... [ 1070.023974] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.024158] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.024275] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.024500] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.024639] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.024937] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.025134] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.025281] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.025489] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.025622] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.025762] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 943cfd14-044c-43ae-aa38-60a9c1769c50 is going to be created. [ 1070.050866] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.051110] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.051219] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.051628] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.051746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.052044] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.683834] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1070.683834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.798074] env[65231]: INFO networking_nsxv3.common.synchronization [req-c0b96d3f-d976-4726-a009-e2743c0470e5 req-8111468a-935b-435c-9ee9-2748431df67d service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1070.798247] env[65231]: INFO networking_nsxv3.common.synchronization [req-c0b96d3f-d976-4726-a009-e2743c0470e5 req-8111468a-935b-435c-9ee9-2748431df67d service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1070.798474] env[65231]: INFO networking_nsxv3.common.synchronization [req-c0b96d3f-d976-4726-a009-e2743c0470e5 req-8111468a-935b-435c-9ee9-2748431df67d service nova] Enqueued Resource ID: 943cfd14-044c-43ae-aa38-60a9c1769c50 with Priority: HIGHEST for action port [ 1070.798946] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1070.799055] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1070.799158] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 943cfd14-044c-43ae-aa38-60a9c1769c50 with Priority: HIGHEST for action port [ 1070.799434] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.799555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.799621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.799834] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.799951] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.800814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.800922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.801138] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-943cfd14-044c-43ae-aa38-60a9c1769c50 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.801239] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.801302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.801472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.801546] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('943cfd14-044c-43ae-aa38-60a9c1769c50',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.277679] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a1828da8-1e34-4c48-8299-a1c7d6ba50e3 None None] Enqueued Resource ID: 8f521d0f-e86d-497e-bd6b-b123f26bead3 with Priority: HIGHEST for action port [ 1071.277679] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f521d0f-e86d-497e-bd6b-b123f26bead3 with Priority: HIGHEST for action port [ 1071.278730] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f521d0f-e86d-497e-bd6b-b123f26bead3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.282981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f521d0f-e86d-497e-bd6b-b123f26bead3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.282981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f521d0f-e86d-497e-bd6b-b123f26bead3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.282981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f521d0f-e86d-497e-bd6b-b123f26bead3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.282981] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f521d0f-e86d-497e-bd6b-b123f26bead3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.306020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.306020] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 943cfd14-044c-43ae-aa38-60a9c1769c50 with status ACTIVE [ 1071.306020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.306020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.306020] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.306020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.306893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.306893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.306893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.306893] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 943cfd14-044c-43ae-aa38-60a9c1769c50 is going to be updated. [ 1071.330160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.331981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.331981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.331981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.331981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.331981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-943cfd14-044c-43ae-aa38-60a9c1769c50" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.625705] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1071.626120] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1071.626120] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.626296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.626423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.626605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.626715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.626778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.626923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.627015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.627114] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.783166] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1071.783466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.783766] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f521d0f-e86d-497e-bd6b-b123f26bead3 [ 1071.784363] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.784363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.784363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.784363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.784548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.784548] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f521d0f-e86d-497e-bd6b-b123f26bead3 already deleted. [ 1071.784548] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f521d0f-e86d-497e-bd6b-b123f26bead3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.969605] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 18s [ 1072.129363] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.158976] env[65231]: INFO networking_nsxv3.common.synchronization [None req-07ea3cc1-df71-46ff-bdc7-a35b7f4a1727 tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1072.158976] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1072.159079] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.159208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.159262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.159514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.159589] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.265971] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0c1896d7-4f9d-4c9d-838f-42599b4a594a tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1072.266382] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1072.266684] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.266781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.636184] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.683297] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.683297] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 already deleted. [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.683297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.683297] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.141031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.141031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.141031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.141031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.141031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.141031] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1073.174428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.174428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.174428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.174428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.174428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.182241] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1073.204964] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.205117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.205189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.205403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.205488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.205610] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 already deleted. [ 1073.205701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.986410] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 20s [ 1074.557723] env[65231]: INFO networking_nsxv3.common.synchronization [None req-30530c78-26e5-47ce-b83b-a2ac76281460 None None] Enqueued Resource ID: 1e644142-6aed-4f28-9269-253d88b271e4 with Priority: HIGHEST for action port [ 1074.558307] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e644142-6aed-4f28-9269-253d88b271e4 with Priority: HIGHEST for action port [ 1074.558614] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e644142-6aed-4f28-9269-253d88b271e4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.558729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e644142-6aed-4f28-9269-253d88b271e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.558838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e644142-6aed-4f28-9269-253d88b271e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.560214] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e644142-6aed-4f28-9269-253d88b271e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.560332] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e644142-6aed-4f28-9269-253d88b271e4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.060398] env[65231]: INFO networking_nsxv3.common.synchronization [req-578824b6-75f0-476b-b8b4-0c8fdba199c8 req-433bd857-9434-4bd6-8570-8dea956c808d tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1075.060994] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1075.061356] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.061460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.061496] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.061690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.061897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.062033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.062033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.062713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.062713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.062713] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.063353] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e644142-6aed-4f28-9269-253d88b271e4 [ 1075.064195] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.064357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.065362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.065362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.065362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.065362] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e644142-6aed-4f28-9269-253d88b271e4 already deleted. [ 1075.065362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e644142-6aed-4f28-9269-253d88b271e4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.195130] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1075.195429] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.196127] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.196344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.196539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.196655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.196721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.196872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.196954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.197995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.199115] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.335291] env[65231]: INFO networking_nsxv3.common.synchronization [req-657be90c-d7f7-4f8d-aed5-546bc98bd717 req-8cb8fa17-d18f-4369-a2a6-d8a669fd1399 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1075.335860] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1075.336195] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.337344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.337344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.337344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.337548] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.337598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.337856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.337856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.337992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.337992] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.566458] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.701277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.701460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.701516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.701729] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.701985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.702088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.702136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.702282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.702371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.702745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.702805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.702975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.703125] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.703236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.703286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.703420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.703493] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.703570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.703657] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.841031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.841031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.841031] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.841304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.841341] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.841593] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.841700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.841854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.841960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.842056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.842145] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1075.874895] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.875104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.875104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.875547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.875547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.885797] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1076.001319] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 22s [ 1076.069979] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.211397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1076.229514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.229652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.229735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.229945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.230016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.230228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.230363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.230402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.230524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.230596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.230766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.230858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.230919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.231069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.231140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.231333] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.231433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.231494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.231629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.231701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.231785] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1076.234929] env[65231]: INFO networking_nsxv3.common.synchronization [req-502583d8-a43c-488a-b8ec-d6c364a43e45 req-14fbaca8-3c9b-493f-9abf-a9ecfa55c282 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 1076.235468] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGHEST for action security_group_members [ 1076.235842] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.235961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.236039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.236198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.236358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.236453] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.236513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.236664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.236738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.236825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.300439] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.300717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.300717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.300804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.300959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.328948] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1076.572602] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.572908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.572977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.575727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.575727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.575727] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be updated. [ 1076.604368] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.605243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.605243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.605243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.605243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.614631] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 1076.741153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.741281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.741281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.741508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.741603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.741809] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.741969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.742028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.742158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.742256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.742319] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 is going to be updated. [ 1076.773098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.773266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.773346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.773540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.773749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.783505] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: IN_PROGRESS for 2s [ 1076.850157] env[65231]: INFO networking_nsxv3.common.synchronization [req-0c92c788-eef8-451f-a6eb-41160e892deb req-c3d4b3b7-4025-418d-93db-6543e7a22586 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1076.850289] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1076.850569] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.850693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.850759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.850957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.851132] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.851237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.851298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.851446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.851530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.851623] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.217203] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.217493] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.217552] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.217771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.218043] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.218206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.218323] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.218645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.218839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.219138] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.219265] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.219374] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.219479] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.219647] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.219792] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.219930] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.240199] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.240380] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.240518] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.240697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-731" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.241017] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-747f9b6a-e4c3-4731-8871-0aed7ded280c taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.241209] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.241331] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.241650] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.241789] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('747f9b6a-e4c3-4731-8871-0aed7ded280c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.353723] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.744479] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.744888] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.745083] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.745416] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.745606] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.745795] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 747f9b6a-e4c3-4731-8871-0aed7ded280c not found, creating... [ 1077.746143] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.746410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.746563] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.746824] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.746998] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.747346] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.747568] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.747721] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.747969] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.748153] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.748332] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 747f9b6a-e4c3-4731-8871-0aed7ded280c is going to be created. [ 1077.781653] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.781899] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.782019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.782357] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.782649] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.782940] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.855927] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.899107] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1077.899785] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 1077.899785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.023691] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 24s [ 1078.341586] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1078.341743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.358472] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.358694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.358694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.358911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.358998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.359117] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1078.388136] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.388333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.388397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.388986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.388986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.399915] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1078.506285] env[65231]: INFO networking_nsxv3.common.synchronization [req-0c92c788-eef8-451f-a6eb-41160e892deb req-bfdabb22-abfd-4510-b813-65ade68255e4 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 1078.506558] env[65231]: INFO networking_nsxv3.common.synchronization [req-0c92c788-eef8-451f-a6eb-41160e892deb req-bfdabb22-abfd-4510-b813-65ade68255e4 service nova] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1078.506802] env[65231]: INFO networking_nsxv3.common.synchronization [req-0c92c788-eef8-451f-a6eb-41160e892deb req-bfdabb22-abfd-4510-b813-65ade68255e4 service nova] Enqueued Resource ID: 747f9b6a-e4c3-4731-8871-0aed7ded280c with Priority: HIGHEST for action port [ 1078.507412] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_rules [ 1078.507548] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1078.507647] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747f9b6a-e4c3-4731-8871-0aed7ded280c with Priority: HIGHEST for action port [ 1078.507933] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.508094] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.508168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.508437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.508566] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.510074] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.510206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.510452] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-747f9b6a-e4c3-4731-8871-0aed7ded280c taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.510792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.510864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.511058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.511138] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('747f9b6a-e4c3-4731-8871-0aed7ded280c',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.625485] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 1078.625728] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.799466] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcecc58c-6471-4f02-a7e2-fe8324893375 in Status: SUCCESS [ 1078.799771] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 deletion is rescheduled due to dependency. [ 1078.799771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.012868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.013107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.013400] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 747f9b6a-e4c3-4731-8871-0aed7ded280c with status ACTIVE [ 1079.013666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.013823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.013936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.014235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.014329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.014551] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.014678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.014722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.014872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.014972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.015166] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.015376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.015376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.015465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.015547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.015595] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 747f9b6a-e4c3-4731-8871-0aed7ded280c is going to be updated. [ 1079.037693] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.037869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.037955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.038167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.038310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.038463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-747f9b6a-e4c3-4731-8871-0aed7ded280c" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.243141] env[65231]: INFO networking_nsxv3.common.synchronization [req-fd8e6285-d905-46d9-bb55-7b371361d3da req-be15ecbb-b282-4054-98ea-9a52041cdf11 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1079.243141] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1079.245498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.245812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.245972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.246270] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.250278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.250278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.250278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.250278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.250278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.250278] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.616216] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.616397] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.616499] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.616756] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.617015] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.617177] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.617291] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.617494] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.617637] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.617843] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.618058] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.618108] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.618172] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.618278] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.618381] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.618510] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.637490] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.637490] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.637490] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.637490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-805" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.637777] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-52d002bd-6e81-4459-bb3d-fa36338e8bbb taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.637946] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.638082] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.638416] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.638708] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d002bd-6e81-4459-bb3d-fa36338e8bbb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.752519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.752721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.752721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.752948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.753058] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.753265] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.753357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.753421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.753577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.753655] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.753743] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1079.797859] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.797990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.799045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.799045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.799045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.808445] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1080.037784] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 26s [ 1080.141498] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.141834] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.142019] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.142346] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.142651] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.142793] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 52d002bd-6e81-4459-bb3d-fa36338e8bbb not found, creating... [ 1080.143238] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.143520] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.143734] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.144118] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.144349] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.144954] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.145358] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.145531] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.145758] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.145903] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.146074] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 52d002bd-6e81-4459-bb3d-fa36338e8bbb is going to be created. [ 1080.190519] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.190755] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.191349] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.191349] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.191666] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.192170] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.412660] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1080.412913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.413086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.413365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.413487] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.413616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.413723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.413810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.413882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.414060] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.910447] env[65231]: INFO networking_nsxv3.common.synchronization [req-fd8e6285-d905-46d9-bb55-7b371361d3da req-523911f8-1fb6-4762-be53-f81914929f2d service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1080.910708] env[65231]: INFO networking_nsxv3.common.synchronization [req-fd8e6285-d905-46d9-bb55-7b371361d3da req-523911f8-1fb6-4762-be53-f81914929f2d service nova] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1080.910748] env[65231]: INFO networking_nsxv3.common.synchronization [req-fd8e6285-d905-46d9-bb55-7b371361d3da req-523911f8-1fb6-4762-be53-f81914929f2d service nova] Enqueued Resource ID: 52d002bd-6e81-4459-bb3d-fa36338e8bbb with Priority: HIGHEST for action port [ 1080.910972] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_rules [ 1080.911113] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1080.911207] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d002bd-6e81-4459-bb3d-fa36338e8bbb with Priority: HIGHEST for action port [ 1080.911746] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.911866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.911933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.912158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.912240] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.913068] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.913202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.913446] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-52d002bd-6e81-4459-bb3d-fa36338e8bbb taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.913551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.913614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.913768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.913840] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d002bd-6e81-4459-bb3d-fa36338e8bbb',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.916322] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.415840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.415840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.415840] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52d002bd-6e81-4459-bb3d-fa36338e8bbb with status ACTIVE [ 1081.416036] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.416036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.416036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.416333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.416333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.417420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.417420] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.417420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.417420] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52d002bd-6e81-4459-bb3d-fa36338e8bbb is going to be updated. [ 1081.418574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.442244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.442244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.442244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.442244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.442244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.442244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52d002bd-6e81-4459-bb3d-fa36338e8bbb" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.670731] env[65231]: INFO networking_nsxv3.common.synchronization [req-234e2ae5-c5e6-45d6-9023-84218a6d6e27 req-3afb17c1-d30d-4c36-bfae-420bfaa6c9e5 tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1081.671700] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1081.672097] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.672266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.672344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.672607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.672769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.672870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.672934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.673098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.673187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.673285] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.818590] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1081.818756] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 1081.818838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.818983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.819225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.819405] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.819515] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.819575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.819717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.819799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.819890] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.921908] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.922318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.922318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.922417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.922449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.922565] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1081.959160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.959331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.959387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.959594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.959742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.973287] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1082.049921] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 28s [ 1082.180054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.180054] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.180054] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 already deleted. [ 1082.180054] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.323850] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.493409] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.493620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.493750] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.496820] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.497246] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.497453] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.497621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.497854] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.498015] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.498239] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.498351] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.498460] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.498566] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.498673] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.499542] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.499756] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.531558] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.531767] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.532047] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.532233] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.532628] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.532922] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.533063] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.534205] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.534205] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.829882] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.036194] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.036615] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.036668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.037107] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.037205] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.037328] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df not found, creating... [ 1083.037666] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.037856] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.037980] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.038230] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.038412] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.038740] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.038908] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.039121] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.039351] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.039499] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.039740] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df is going to be created. [ 1083.064123] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.064465] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.064555] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.064845] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.065152] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.065471] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.333071] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.333400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.333564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.333825] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.333960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.335691] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1083.370043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.371257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.371349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.371586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.371770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.383623] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1083.766472] env[65231]: INFO networking_nsxv3.common.synchronization [req-234e2ae5-c5e6-45d6-9023-84218a6d6e27 req-a19710ff-1370-4bd7-a80e-f070f07fa0c2 service nova] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1083.766692] env[65231]: INFO networking_nsxv3.common.synchronization [req-234e2ae5-c5e6-45d6-9023-84218a6d6e27 req-a19710ff-1370-4bd7-a80e-f070f07fa0c2 service nova] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1083.766826] env[65231]: INFO networking_nsxv3.common.synchronization [req-234e2ae5-c5e6-45d6-9023-84218a6d6e27 req-a19710ff-1370-4bd7-a80e-f070f07fa0c2 service nova] Enqueued Resource ID: 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df with Priority: HIGHEST for action port [ 1083.767463] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_rules [ 1083.767600] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1083.768021] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df with Priority: HIGHEST for action port [ 1083.768021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.768631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.768725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.768933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.768995] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.769865] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.770856] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.770856] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.770856] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.773037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.773037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.773037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.773037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.773037] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.985272] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1083.985491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.985671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.985901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.986199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.986456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.986521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.986630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.987128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.987128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.987128] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.061649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 30s [ 1084.277453] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.279725] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.279973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.280451] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df with status ACTIVE [ 1084.280641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.280755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.280885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.281166] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.281959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.282266] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.282396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.282464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.287246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.288458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.288458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.288458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.288458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.288458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.288458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.288458] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df is going to be updated. [ 1084.317522] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.318066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.318180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.318668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.318852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.319183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d7a6d6-dd8d-4f1c-a756-2a3bce6bf6df" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.490468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.490468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.490468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.490468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.490468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.490881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.490881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.490881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.490881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.491047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.491133] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.491245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.491287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.491417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.491553] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.491641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.492056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.492056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.492056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.492183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.492183] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.781475] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.995210] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5784cc-7357-491d-87fc-9e86cfa66f0a: rpc.has_security_group_logging(os_id): False [ 1085.017868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.018107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.018107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.018267] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.018351] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.018582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.018707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.018740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.018919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.018981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.019313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.019313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.019313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.019476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.019506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.019692] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.019805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.019858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.019994] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.022423] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.022423] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1085.211849] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.211849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.212327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.212327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.212327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.229910] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1085.283802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.284541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.284983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.285568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.285986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.286443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 is going to be created. [ 1085.326193] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.326662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.327942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.327942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.327942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.349678] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: UNINITIALIZED for 2s [ 1085.396373] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1085.397770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.397770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.397770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.397770] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.397770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.397770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.398175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.398175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.398280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.398415] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.901381] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.901630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.901708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.901934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.902158] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.902266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.902338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.902489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.902571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.902657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.902847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.902968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.903077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.903332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.903437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.903544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.903637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.903793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.903872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.903985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.904225] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.075072] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 32s [ 1086.407602] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2d80f7f-757f-4f15-9618-2e66c9f29176: rpc.has_security_group_logging(os_id): False [ 1086.426307] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.426524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.426563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.426774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.427048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.427149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.427149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.427233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.427361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.427442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.427626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.427718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.427777] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.427913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.427985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.428199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.428293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.428353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.428489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.428564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.428649] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1086.492246] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.492397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.492480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.492694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.492843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.507807] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1087.246207] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1087.246526] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.363154] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: SUCCESS [ 1087.363459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.363687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.363936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.364214] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.364338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.364405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.364670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.364670] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.364911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.364911] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.867825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.088653] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 34s [ 1088.370965] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e958c59-3715-4529-9e10-dbe4830c94e6: rpc.has_security_group_logging(os_id): False [ 1088.391741] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.391945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.391945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.392247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.392352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.392630] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.392741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.392806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.392978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.393097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.393198] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 is going to be created. [ 1088.471785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.472096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.472180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.472355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.472541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.489869] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: IN_PROGRESS for 2s [ 1088.529182] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1088.529399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.638487] env[65231]: INFO networking_nsxv3.common.synchronization [req-af3539e2-bb14-4862-9c7d-49f1746b676b req-a4b8a71c-8a25-4b48-b28f-684afcd1dab7 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1088.639172] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7635576-86a3-4c1e-879c-905a9e43f478 with Priority: HIGHEST for action security_group_members [ 1088.639485] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7635576-86a3-4c1e-879c-905a9e43f478 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.639696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.639765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.639960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.640129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.640230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.640293] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.640505] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.640611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.640707] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7635576-86a3-4c1e-879c-905a9e43f478',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.144524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.144907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.144907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.145071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.145105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.145291] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.145538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.145538] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.145648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.145755] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.145812] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 is going to be updated. [ 1089.185277] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.185523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.185523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.185751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.185932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.199761] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: IN_PROGRESS for 2s [ 1090.101351] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 36s [ 1090.506652] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: SUCCESS [ 1090.507096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.211246] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7635576-86a3-4c1e-879c-905a9e43f478 in Status: SUCCESS [ 1091.211432] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7635576-86a3-4c1e-879c-905a9e43f478 deletion is rescheduled due to dependency. [ 1091.211545] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7635576-86a3-4c1e-879c-905a9e43f478" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.117365] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 38s [ 1092.560732] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e63e5ed-6c4f-4e6c-8b7e-d9b4287c48de req-27c68580-df11-4c70-a26a-c72389c7b854 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1092.560732] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1092.560732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.560732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.560732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.560732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.560732] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.562329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.562826] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.563162] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.563469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.563668] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.950805] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.951313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.952057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.952057] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.953832] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.953832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.953832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.953832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.953832] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.953832] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.953832] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.953832] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.954195] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.954195] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.954349] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.954541] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.958239] env[65231]: INFO networking_nsxv3.common.synchronization [req-d6777c3f-5224-4acb-b800-dbb0235d1d2f req-968eabc1-3b6f-4d02-be60-3aba0513b7ef tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1092.959841] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1092.961898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.962029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.962101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.962287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.962476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.962578] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.962640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.962792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.962875] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.962966] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.977618] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.977781] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.977916] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.978098] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-663" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.978393] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-467e0a51-5bdb-40bc-94f3-96d929ffbad3 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.978557] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.978675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.978991] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.979141] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('467e0a51-5bdb-40bc-94f3-96d929ffbad3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.067469] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.465826] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.481136] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.481319] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.481680] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.481983] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.482174] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.482348] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 467e0a51-5bdb-40bc-94f3-96d929ffbad3 not found, creating... [ 1093.482783] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.482783] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.482924] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.483200] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.483363] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.483658] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.483948] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.483948] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.484207] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.484367] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.484510] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 467e0a51-5bdb-40bc-94f3-96d929ffbad3 is going to be created. [ 1093.507187] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.507434] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.507560] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.507840] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.508079] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.508303] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.570031] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.968756] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.049462] env[65231]: INFO networking_nsxv3.common.synchronization [req-1af965d0-3368-4122-9816-d3621d1d227f req-f825e061-7bdc-459f-9add-be2d996573e0 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1094.050218] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1094.050628] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.050814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.050902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.051666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.051666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.051666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.051666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.051883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.051883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.051974] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.071293] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.071416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.072480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.072480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.072480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.072480] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be updated. [ 1094.121783] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.121966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.122014] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.122414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.122414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.131364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 40s [ 1094.132919] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 1094.250816] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e63e5ed-6c4f-4e6c-8b7e-d9b4287c48de req-de1a906f-d1cb-4ae8-96bc-6628f2963cf2 service nova] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 1094.250998] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e63e5ed-6c4f-4e6c-8b7e-d9b4287c48de req-de1a906f-d1cb-4ae8-96bc-6628f2963cf2 service nova] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1094.251158] env[65231]: INFO networking_nsxv3.common.synchronization [req-5e63e5ed-6c4f-4e6c-8b7e-d9b4287c48de req-de1a906f-d1cb-4ae8-96bc-6628f2963cf2 service nova] Enqueued Resource ID: 467e0a51-5bdb-40bc-94f3-96d929ffbad3 with Priority: HIGHEST for action port [ 1094.251660] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_rules [ 1094.251790] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1094.251884] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 467e0a51-5bdb-40bc-94f3-96d929ffbad3 with Priority: HIGHEST for action port [ 1094.252313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.252511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.252599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.252822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.252927] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.253840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.255085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.255313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-467e0a51-5bdb-40bc-94f3-96d929ffbad3 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.255419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.255492] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.255760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.255838] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('467e0a51-5bdb-40bc-94f3-96d929ffbad3',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.476046] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.476349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.476349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.476543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.476617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.476676] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1094.512977] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.513246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.513911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.513911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.513911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.525380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1094.554644] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.554828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.554890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.555113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.555203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.555409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.555510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.555569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.555720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.555793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.555878] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1094.605022] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.605022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.605022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.605022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.605022] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.613405] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1094.721153] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f52df6e1-5fc3-409b-8be4-9659fecc7636 tempest-AttachInterfacesTestJSON-751010216 tempest-AttachInterfacesTestJSON-751010216-project-member] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1094.721153] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGHEST for action security_group_members [ 1094.721153] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.723454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.725968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.725968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.725968] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.757649] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.757901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.762335] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 467e0a51-5bdb-40bc-94f3-96d929ffbad3 with status ACTIVE [ 1094.763221] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.763221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.763221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.763221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.763221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.763769] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.763769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.763769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.763769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.763967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.764080] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.764161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.764226] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.764378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.764457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.764543] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 467e0a51-5bdb-40bc-94f3-96d929ffbad3 is going to be updated. [ 1094.802251] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.802969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.802969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.802969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.803117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.803352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-467e0a51-5bdb-40bc-94f3-96d929ffbad3" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.227902] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.228243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.228400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.228748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.228915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.229226] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.229402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.229523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.229799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.229952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.230127] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be updated. [ 1095.287657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.287884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.287971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.288266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.288467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.300259] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: IN_PROGRESS for 2s [ 1096.142114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 1096.142509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.142509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.142704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.142898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.143039] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.143107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.143354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.143448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.143546] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.148763] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 42s [ 1096.537630] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1096.537866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.628642] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1096.628822] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1096.628927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.650493] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.157078] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.328268] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f698486-5433-4f5d-838f-8989284e2ed7 in Status: SUCCESS [ 1097.328440] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 deletion is rescheduled due to dependency. [ 1097.328572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.661428] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.661648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.661648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.661904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.662013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.662152] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be updated. [ 1097.694382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.694513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.694602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.694844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.695042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.709688] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 1098.163426] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 44s [ 1099.720144] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 1099.720524] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.720793] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1099.721037] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1099.721190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.721441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.722044] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.722044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.722044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.722269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.722307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.722421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.722556] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.173994] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 46s [ 1100.228585] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.731729] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 815e1e30-e3ab-42b0-b86b-fcd2a81435a2: rpc.has_security_group_logging(os_id): False [ 1100.755543] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.755726] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.756215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.756482] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.783216] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.783506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.783630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.783694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.783893] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.783963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.784071] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be updated. [ 1100.857967] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.858132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.858204] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.858416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.858599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.876921] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 1101.930659] env[65231]: INFO networking_nsxv3.common.synchronization [req-e5a74d30-7bdb-4258-8137-8a324abfeb98 req-d37da759-a67b-4987-8e32-b58ff8fe5ee8 tempest-ServersTestJSON-1974066447 tempest-ServersTestJSON-1974066447-project-member] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1101.931312] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGHEST for action security_group_members [ 1101.931689] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.931876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.931975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.932210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.932399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.932529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.932613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.932783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.932897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.933026] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.189919] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 48s [ 1102.436968] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.437527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.437527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.437527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.437787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.438349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.438349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.438349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.438349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.438349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.438349] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be updated. [ 1102.469447] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.469646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.469759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.470015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.470174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.481925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: IN_PROGRESS for 2s [ 1102.650527] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e0046957-bd15-4d6a-9203-7ccfc8f82be0 tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1102.650527] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1102.650527] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.650642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.650690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.650956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.651144] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.751885] env[65231]: INFO networking_nsxv3.common.synchronization [None req-3f5286db-8028-4797-842c-ee5218066e9f tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1102.751885] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1102.751885] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.751885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.893446] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 1102.893676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.171669] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.171669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.172114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.172114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.172236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.172379] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f already deleted. [ 1103.172513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.173073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.173073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.173073] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.446712] env[65231]: INFO networking_nsxv3.common.synchronization [req-ec865af9-1961-4b88-95ff-a5fc5ca0b165 req-f1156ccc-bd25-4f2b-81f7-ce8957c7fef4 tempest-ImagesTestJSON-752871597 tempest-ImagesTestJSON-752871597-project-member] Enqueued Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1103.447777] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 with Priority: HIGHEST for action security_group_members [ 1103.448088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2d80f7f-757f-4f15-9618-2e66c9f29176 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.448309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.448309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.448464] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.449125] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.449125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.449125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.449125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.449125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.449125] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2d80f7f-757f-4f15-9618-2e66c9f29176',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.692519] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.692693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.692693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.692873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.692962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.693070] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f already deleted. [ 1103.693153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.951146] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.951301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.951735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.951830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.951924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.952134] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.952262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.952345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.952510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.952628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.952679] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 is going to be updated. [ 1103.983520] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.984132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.984132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.984132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.984132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.996058] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: IN_PROGRESS for 2s [ 1104.201835] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 50s [ 1104.490998] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a in Status: SUCCESS [ 1104.491193] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a deletion is rescheduled due to dependency. [ 1104.491518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.005526] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 in Status: SUCCESS [ 1106.005867] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2d80f7f-757f-4f15-9618-2e66c9f29176 deletion is rescheduled due to dependency. [ 1106.005963] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2d80f7f-757f-4f15-9618-2e66c9f29176" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.212603] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 52s [ 1108.224999] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 54s [ 1108.449081] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1108.449081] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1110.249042] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 56s [ 1110.263807] env[65231]: INFO networking_nsxv3.common.synchronization [req-c46fa339-031d-440d-b001-163d0a4fcd1e req-5d676257-15bd-43f3-a343-385c8bc84d83 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1110.264888] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1110.264888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.265606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.265606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.268852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.268852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.268852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.268852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.268852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.268852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.268852] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.675447] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.675669] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.675829] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.676141] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.676428] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.676620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.676771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.677010] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.678530] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.678747] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.678868] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.678981] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.679106] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.679217] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.679321] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.679454] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.704224] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.704224] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.704224] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.704224] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.704224] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-00356172-5916-4d30-b348-8b17bfc532ad taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.704621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.704784] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.706396] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.706396] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00356172-5916-4d30-b348-8b17bfc532ad',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.772151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.772432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.772432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.772606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.772749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.772882] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.772990] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.773057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.773201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.773269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.773358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1110.803236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.803610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.803610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.803870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.804110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.815779] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1111.208450] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.208692] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.210371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 00356172-5916-4d30-b348-8b17bfc532ad not found, creating... [ 1111.210371] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.210371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.210799] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.210799] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.210799] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.211016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.211142] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.211294] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 00356172-5916-4d30-b348-8b17bfc532ad is going to be created. [ 1111.234522] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.234769] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.234895] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.235242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.235613] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.235882] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.947697] env[65231]: INFO networking_nsxv3.common.synchronization [req-c46fa339-031d-440d-b001-163d0a4fcd1e req-2cc8b6cb-a42c-4056-bfed-4ad12295bbe9 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1111.947995] env[65231]: INFO networking_nsxv3.common.synchronization [req-c46fa339-031d-440d-b001-163d0a4fcd1e req-2cc8b6cb-a42c-4056-bfed-4ad12295bbe9 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1111.947995] env[65231]: INFO networking_nsxv3.common.synchronization [req-c46fa339-031d-440d-b001-163d0a4fcd1e req-2cc8b6cb-a42c-4056-bfed-4ad12295bbe9 service nova] Enqueued Resource ID: 00356172-5916-4d30-b348-8b17bfc532ad with Priority: HIGHEST for action port [ 1111.948547] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1111.948733] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1111.948768] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00356172-5916-4d30-b348-8b17bfc532ad with Priority: HIGHEST for action port [ 1111.949091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.949272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.949305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.949514] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.949637] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.951040] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.951238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.952108] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-00356172-5916-4d30-b348-8b17bfc532ad taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.952248] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.952332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.952541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.952622] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00356172-5916-4d30-b348-8b17bfc532ad',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.259291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 58s [ 1112.451630] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.451938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.456321] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00356172-5916-4d30-b348-8b17bfc532ad with status ACTIVE [ 1112.456830] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.456830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.456830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.457542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.457542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.457542] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.457542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.457542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.457800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.457800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.457903] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.457996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.458073] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.458213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.458286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.458371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00356172-5916-4d30-b348-8b17bfc532ad is going to be updated. [ 1112.488623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.488838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.488838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.489914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.491289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.491289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00356172-5916-4d30-b348-8b17bfc532ad" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.827870] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1112.828167] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1112.828357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.828572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.828865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.829113] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.829261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.829361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.829547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.829662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.829859] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.333181] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.835659] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.271049] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 60s [ 1114.339560] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.339891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.339891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.340088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.340185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.340325] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1114.372415] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.372649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.372693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.372948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.373143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.384145] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1115.041314] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.041440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.041525] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.041796] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.042058] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.042222] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.042344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.042562] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.042714] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.042914] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.043222] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.043387] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.043503] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.043618] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.043723] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.043857] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.066144] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.066454] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.066641] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.066875] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-22" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.067285] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-70fdf875-08a5-4f50-88c7-fe2369444274 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.067508] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.067834] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.068168] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.068344] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fdf875-08a5-4f50-88c7-fe2369444274',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.571468] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.571905] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.571905] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.572122] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.572275] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.572641] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.572821] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.572962] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.573210] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.573355] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.573636] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.573790] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.573958] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.574229] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.574370] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.574563] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 70fdf875-08a5-4f50-88c7-fe2369444274 is going to be updated. [ 1115.596054] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.596278] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.596398] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.596668] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.596868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.597100] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.885250] env[65231]: INFO networking_nsxv3.common.synchronization [req-69f9d31e-05a0-420b-91a7-af84b70dea03 req-955184ef-746c-4189-a5b5-ab1591eeedf7 tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1115.885872] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1115.886182] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.886305] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.886995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.886995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.886995] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.886995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.886995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.886995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.887339] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.887339] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.283309] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 62s [ 1116.388898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.389065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.389111] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.389336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.389430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.389626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.389742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.389817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.389928] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.390008] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.390104] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1116.391767] env[65231]: INFO networking_nsxv3.common.synchronization [req-9c07b97a-98f2-463a-8ec0-47dbc6be1d79 req-49d6ee22-c459-4433-afd5-d86016f0ef07 service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 1116.391947] env[65231]: INFO networking_nsxv3.common.synchronization [req-9c07b97a-98f2-463a-8ec0-47dbc6be1d79 req-49d6ee22-c459-4433-afd5-d86016f0ef07 service nova] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1116.392546] env[65231]: INFO networking_nsxv3.common.synchronization [req-9c07b97a-98f2-463a-8ec0-47dbc6be1d79 req-49d6ee22-c459-4433-afd5-d86016f0ef07 service nova] Enqueued Resource ID: 70fdf875-08a5-4f50-88c7-fe2369444274 with Priority: HIGHEST for action port [ 1116.393125] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_rules [ 1116.393320] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1116.393416] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fdf875-08a5-4f50-88c7-fe2369444274 with Priority: HIGHEST for action port [ 1116.394088] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.394229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.394298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.394529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.394613] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.395547] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.396568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.396568] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.396568] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.397262] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-70fdf875-08a5-4f50-88c7-fe2369444274 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.397360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.397431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.397576] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.398350] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fdf875-08a5-4f50-88c7-fe2369444274',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.399391] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1116.399474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.400137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.400137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.400253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.400321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.400321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.400469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.400556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.400631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.400714] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.423656] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.423656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.423656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.423656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.423900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.434237] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1116.899647] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.900085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.900085] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.901621] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70fdf875-08a5-4f50-88c7-fe2369444274 with status ACTIVE [ 1116.901905] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.902072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.902132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.902400] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.902462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.902642] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.902781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.902845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.902992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.903088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.903270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.903361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.903431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.903631] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.903717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.903805] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70fdf875-08a5-4f50-88c7-fe2369444274 is going to be updated. [ 1116.905102] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.905215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.905309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.905422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.905612] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.905715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.905778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.905942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.906013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.906075] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.906220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.906308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.906361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.906497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.906635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.906737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.906802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.906908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.906988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.907068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.907155] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.934802] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.935070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.935070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.935259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.935372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.935540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70fdf875-08a5-4f50-88c7-fe2369444274" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.401849] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.409717] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1117.428463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.428649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.428701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.428911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.429008] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.429250] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.429368] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.429416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.429585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.429663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.429840] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.429934] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.429995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.430148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.430221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.430409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.430502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.430564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.430696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.430768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.430850] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1117.496169] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.496169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.496377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.496484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.496636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.508788] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1117.904147] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.904562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.904562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.904676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.904775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.904860] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1117.963651] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.963899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.964016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.964284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.964459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.975217] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1118.297192] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 64s [ 1118.447411] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1118.447584] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 deletion is rescheduled due to dependency. [ 1118.447693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.524261] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1119.524633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.829116] env[65231]: INFO networking_nsxv3.common.synchronization [req-b23939d4-a433-4e64-b96d-acddb5771e1a req-b5a96892-ecf7-4220-82e1-1c7f0a653243 tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1119.829116] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1119.829384] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.829481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.829534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.830256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.830256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.830256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.830256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.830571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.830571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.830571] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.987809] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.987809] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.987809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.987809] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.172617] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.173284] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.173459] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.173729] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.174074] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.174253] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.174406] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.174740] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.174954] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.175382] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.175485] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.175694] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.175896] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.176104] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.176278] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.176524] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.201505] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.201505] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.201739] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.201792] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-145" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.202116] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.202378] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.202599] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.202965] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.203175] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993ef683-d4a0-48ea-bc70-f6ba2ddacab2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.311430] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 66s [ 1120.335254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.335432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.336056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.336361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.336527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.336858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.337045] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.337149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.337353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.337459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.337571] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f already deleted. [ 1120.337713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.489568] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.489769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.489809] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.490021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.490196] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.490301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.490391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.490518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.490605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.490695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.490864] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.490958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.491028] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.491175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.491314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.491405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.491465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.491604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.491684] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.491766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.491858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.706102] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.706449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.706449] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.706937] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.707024] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.707190] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 not found, creating... [ 1120.707452] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.707612] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.707729] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.707955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.708108] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.708411] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.708653] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.708770] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.708979] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.709125] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.709263] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 is going to be created. [ 1120.731144] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.731387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.731515] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.731815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.732086] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.732340] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.993962] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d0c669-d29b-4033-86e4-fdbf9e070f07: rpc.has_security_group_logging(os_id): False [ 1121.020588] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.020819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.020819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.021212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.021212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.021396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.021552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.021552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.021810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.021810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.021976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.022227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.022227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.022327] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.022436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.022626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.022721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.022721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.023546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.023546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.023546] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1121.166315] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.166315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.166315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.167215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.167215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.182419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1121.464192] env[65231]: INFO networking_nsxv3.common.synchronization [req-b23939d4-a433-4e64-b96d-acddb5771e1a req-8ed18b8d-6246-48d3-8668-7f629237c7b9 service nova] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1121.464192] env[65231]: INFO networking_nsxv3.common.synchronization [req-b23939d4-a433-4e64-b96d-acddb5771e1a req-8ed18b8d-6246-48d3-8668-7f629237c7b9 service nova] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1121.464192] env[65231]: INFO networking_nsxv3.common.synchronization [req-b23939d4-a433-4e64-b96d-acddb5771e1a req-8ed18b8d-6246-48d3-8668-7f629237c7b9 service nova] Enqueued Resource ID: 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 with Priority: HIGHEST for action port [ 1121.464360] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_rules [ 1121.464427] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1121.464591] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 with Priority: HIGHEST for action port [ 1121.464892] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.465279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.465279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.465494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.465551] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.467211] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.467426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.467502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.467853] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.468951] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.468951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.468951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.468951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.468951] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.468951] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.469534] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.469534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.470202] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.470321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.470705] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993ef683-d4a0-48ea-bc70-f6ba2ddacab2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.967655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.968025] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.973445] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.973639] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 with status ACTIVE [ 1121.973673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.974258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.974258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.974258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.974258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.974500] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.974571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.974786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.974840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.974873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.976160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.976160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.976160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.976160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.976160] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.976160] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 993ef683-d4a0-48ea-bc70-f6ba2ddacab2 is going to be updated. [ 1122.000065] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.000151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.000222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.001043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.001043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.001043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993ef683-d4a0-48ea-bc70-f6ba2ddacab2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.324424] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 68s [ 1122.478282] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.983569] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.983569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.983569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.984123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.984123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.984123] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f is going to be created. [ 1123.010394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.010618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.010618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.010812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.010959] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.022405] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: UNINITIALIZED for 2s [ 1123.198475] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1123.199057] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.339308] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 70s [ 1125.035043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: SUCCESS [ 1125.035271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.035420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.035642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.035870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.036033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.036103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.036412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.036412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.036412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.037692] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.539962] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.044665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d87cdd94-ecdf-4643-9622-6c738c69cd1f: rpc.has_security_group_logging(os_id): False [ 1126.065249] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.065398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.065472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.065712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.065814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.066082] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.066207] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.066262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.066408] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.066511] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.066567] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f is going to be created. [ 1126.127177] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.127316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.127387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.127598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.127796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.139227] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: IN_PROGRESS for 2s [ 1126.351287] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 72s [ 1126.466018] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1126.466217] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1127.883603] env[65231]: INFO networking_nsxv3.common.synchronization [req-ab1302ab-f69f-4fce-9985-b089b433eb6b req-7d96527c-496b-4c8e-9e10-7f0111e0840d tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1127.883603] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1127.884347] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.884906] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.885268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.886194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.886194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.886194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.886194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.886194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.886194] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.886602] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.156848] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: SUCCESS [ 1128.157108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.365299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 74s [ 1128.389020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.389263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.389403] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.389600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.389696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.389970] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.390144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.390144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.390340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.390340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.390467] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1128.423092] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.423300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.423300] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.423542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.423737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.437525] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1130.396831] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 76s [ 1130.448290] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1130.448538] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 deletion is rescheduled due to dependency. [ 1130.448919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.796346] env[65231]: INFO networking_nsxv3.common.synchronization [req-04d12925-b683-411b-803c-cdc4c699c1ef req-ba464220-ae3f-498c-94e9-f1d838cd157f tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1131.797538] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1131.797724] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.797791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.797902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.798105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.798296] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.798405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.798467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.798637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.798757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.798858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.133530] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.133717] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.133907] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.134240] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.135448] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.135448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.135448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.135448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.135448] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.135448] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.135963] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.135963] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.135963] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.135963] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.136101] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.136233] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.159823] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.160037] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.160220] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.160428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.160780] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-f4cff5e7-3d00-4a50-b549-ca51137525d7 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.160992] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.161177] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.161547] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.161718] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cff5e7-3d00-4a50-b549-ca51137525d7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.301427] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.301707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.301838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.302184] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.302362] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.302730] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.302884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.302993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.303272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.303418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.303582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1132.338334] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.338334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.338334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.338334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.338334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.349688] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1132.414432] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: IN_PROGRESS for 78s [ 1132.667306] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.667693] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.667944] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.668483] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.668781] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.669098] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port f4cff5e7-3d00-4a50-b549-ca51137525d7 not found, creating... [ 1132.669964] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.670275] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.670546] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.670891] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.671115] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.671528] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.671772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.672034] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.672413] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.672774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.673100] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: f4cff5e7-3d00-4a50-b549-ca51137525d7 is going to be created. [ 1132.703731] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.703731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.703731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.703731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.703731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.703731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.435186] env[65231]: INFO networking_nsxv3.common.synchronization [req-04d12925-b683-411b-803c-cdc4c699c1ef req-0b8bfec7-d069-479c-b73b-5388c4f55ac3 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1133.435186] env[65231]: INFO networking_nsxv3.common.synchronization [req-04d12925-b683-411b-803c-cdc4c699c1ef req-0b8bfec7-d069-479c-b73b-5388c4f55ac3 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1133.435468] env[65231]: INFO networking_nsxv3.common.synchronization [req-04d12925-b683-411b-803c-cdc4c699c1ef req-0b8bfec7-d069-479c-b73b-5388c4f55ac3 service nova] Enqueued Resource ID: f4cff5e7-3d00-4a50-b549-ca51137525d7 with Priority: HIGHEST for action port [ 1133.435756] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1133.435889] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1133.435986] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4cff5e7-3d00-4a50-b549-ca51137525d7 with Priority: HIGHEST for action port [ 1133.436454] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.436580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.436645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.436838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.436920] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.438490] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.438593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.438805] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4cff5e7-3d00-4a50-b549-ca51137525d7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.438927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.438992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.439188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.439268] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cff5e7-3d00-4a50-b549-ca51137525d7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.939604] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.939604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.944253] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4cff5e7-3d00-4a50-b549-ca51137525d7 with status ACTIVE [ 1133.944253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.944253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.944253] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.944253] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.947653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.947653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.947653] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4cff5e7-3d00-4a50-b549-ca51137525d7 is going to be updated. [ 1133.978200] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.978373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.978452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.978716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.978885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.979076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4cff5e7-3d00-4a50-b549-ca51137525d7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.376601] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1134.376808] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 deletion is rescheduled due to dependency. [ 1134.376929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.377247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.377416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.377617] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.377709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.377748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.377914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.377988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.378079] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.432331] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e382486-015d-44b8-a3e5-a0f228b61242 in Status: SUCCESS [ 1134.432636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.884025] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.383834] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.886154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.886619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.886619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.886911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.887173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.887382] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1135.924393] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.924686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.924973] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.925357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.925609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.937338] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1137.490423] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.490732] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.490732] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.490991] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.491255] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.491409] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.491524] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.492136] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.492307] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.492519] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.492627] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.492772] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.492877] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.492988] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.493108] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.493242] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.511544] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.511709] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1137.511842] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.512024] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-129" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.512340] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-244d67eb-de1a-45e5-b154-bd96f3564e79 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.512513] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.512631] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.512892] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.513040] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244d67eb-de1a-45e5-b154-bd96f3564e79',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.947789] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1137.948037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.948210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.948438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948634] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.948735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.948808] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.949088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.949205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.949319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.949421] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.016028] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.016314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.016441] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.016731] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.016887] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.017328] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.017546] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.017718] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.017998] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.018189] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.018531] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.018714] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.018837] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.019076] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.019215] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.019358] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 is going to be updated. [ 1138.058795] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.059026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.059153] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.059423] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.059621] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.059840] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.437911] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.437911] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1138.452036] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.794938] env[65231]: INFO networking_nsxv3.common.synchronization [req-19b94d82-6853-4ee2-8fa4-5de969dc55e0 req-4f9069b8-faeb-4654-856b-aaa0958be4b6 service nova] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1138.795205] env[65231]: INFO networking_nsxv3.common.synchronization [req-19b94d82-6853-4ee2-8fa4-5de969dc55e0 req-4f9069b8-faeb-4654-856b-aaa0958be4b6 service nova] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1138.795395] env[65231]: INFO networking_nsxv3.common.synchronization [req-19b94d82-6853-4ee2-8fa4-5de969dc55e0 req-4f9069b8-faeb-4654-856b-aaa0958be4b6 service nova] Enqueued Resource ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 with Priority: HIGHEST for action port [ 1138.795916] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_rules [ 1138.796091] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1138.796189] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 with Priority: HIGHEST for action port [ 1138.796560] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.796717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.796812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.797050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.797173] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.798465] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.798617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.798702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.798911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.799098] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.799261] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.799343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.799534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.799661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.799778] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.800722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-244d67eb-de1a-45e5-b154-bd96f3564e79 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.800795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.800899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.801080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.801166] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244d67eb-de1a-45e5-b154-bd96f3564e79',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.953737] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46aaaa81-68ab-4e7d-baa6-29897d6cee13: rpc.has_security_group_logging(os_id): False [ 1138.974992] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.975196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.975249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.975534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.975711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.976079] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.976232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.976296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.976502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.976680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.976743] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1139.041027] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.041260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.041260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.041484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.041636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.054904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1139.303225] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.304052] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.304183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.304329] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 244d67eb-de1a-45e5-b154-bd96f3564e79 with status ACTIVE [ 1139.304532] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.304598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.305177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.305177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.305177] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.305349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.305349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.305349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.306055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.306055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.306055] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.306055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.306055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.306302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.306302] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.306302] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 244d67eb-de1a-45e5-b154-bd96f3564e79 is going to be updated. [ 1139.330240] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.330342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.330393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.330594] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.330731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.330886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244d67eb-de1a-45e5-b154-bd96f3564e79" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.808708] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.311884] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.312163] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.312258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.312546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.312675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.312834] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 is going to be updated. [ 1140.407156] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.407434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.407434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.407537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.407681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.436950] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: IN_PROGRESS for 2s [ 1141.069897] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1141.070812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.975716] env[65231]: INFO networking_nsxv3.common.synchronization [None req-0b4bd72c-c6e0-4c13-a4d2-d2b16e45cee6 None None] Enqueued Resource ID: 6aedbc69-a404-49e7-b5f4-b86ebdccda77 with Priority: HIGHEST for action port [ 1141.976567] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aedbc69-a404-49e7-b5f4-b86ebdccda77 with Priority: HIGHEST for action port [ 1141.977047] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aedbc69-a404-49e7-b5f4-b86ebdccda77 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.977219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aedbc69-a404-49e7-b5f4-b86ebdccda77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.977335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aedbc69-a404-49e7-b5f4-b86ebdccda77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.977830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aedbc69-a404-49e7-b5f4-b86ebdccda77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.977830] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aedbc69-a404-49e7-b5f4-b86ebdccda77',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.447419] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: SUCCESS [ 1142.447694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.447884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.448123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.448337] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.448473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.449050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.449050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.449050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.449050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.449050] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.483636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6aedbc69-a404-49e7-b5f4-b86ebdccda77 [ 1142.483636] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.483636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6aedbc69-a404-49e7-b5f4-b86ebdccda77 already deleted. [ 1142.483636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aedbc69-a404-49e7-b5f4-b86ebdccda77" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.895178] env[65231]: INFO networking_nsxv3.common.synchronization [None req-7ac6999c-a643-4cec-a1a1-fed25b788091 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1142.896328] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1142.896526] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.896714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.896842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.897822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.897822] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.911234] env[65231]: INFO networking_nsxv3.common.synchronization [req-32795417-a96c-452a-8bbf-df5c9db70425 req-b49aa215-d8a8-4598-bd36-7a5f66558d03 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1142.911957] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1142.913670] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.913845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.913931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.914165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.914350] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.914480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.914575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.914967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.914967] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.915093] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.957269] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.107479] env[65231]: INFO networking_nsxv3.common.synchronization [None req-2f4be227-ebf3-4c69-ac07-973e3522cd21 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1143.108676] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1143.108766] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.108901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.371260] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.375040] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.375040] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.375040] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.375040] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.375040] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.375040] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.375040] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.375040] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.375040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.402078] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.402078] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.402078] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.402078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.402078] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-b2ad5d98-71b8-4885-9875-1ff229fb053d taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.402078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.402078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.402078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.402638] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ad5d98-71b8-4885-9875-1ff229fb053d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.421666] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.422254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.422254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.422445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.422485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.422956] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.422956] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.423169] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.423306] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.423447] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.423579] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1143.426574] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.426689] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.426742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.426938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.427044] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.427303] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a920363-f837-4140-baf1-68f68c922101 already deleted. [ 1143.427303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.427402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.427523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.427623] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.459942] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d545a86-14ce-4276-b4f9-c746b41ad9f0: rpc.has_security_group_logging(os_id): False [ 1143.466462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.466698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.466698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.466867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.467052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.479026] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1143.480100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.480263] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.480331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.480585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.480693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.480955] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.481123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.481205] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.481392] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.481461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.481537] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 is going to be updated. [ 1143.567024] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.567024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.567024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.567024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.567024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.583128] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: IN_PROGRESS for 2s [ 1143.907437] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.907685] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.907813] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.908174] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.908878] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.908878] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port b2ad5d98-71b8-4885-9875-1ff229fb053d not found, creating... [ 1143.908878] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.909081] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.909081] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.909311] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.909382] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.909696] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.909902] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.910052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.910890] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.910890] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.910890] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: b2ad5d98-71b8-4885-9875-1ff229fb053d is going to be created. [ 1143.932831] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.933046] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.933178] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.933440] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.933687] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.933909] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.955593] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.955754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.955798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.956013] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.956102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.956202] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a920363-f837-4140-baf1-68f68c922101 already deleted. [ 1143.956307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.455528] env[65231]: INFO networking_nsxv3.common.synchronization [None req-7895ce88-3107-4c87-89d2-0578a6aad77a None None] Enqueued Resource ID: 30e1e8ee-3d67-449c-a96e-e5db11f35e2e with Priority: HIGHEST for action port [ 1144.456185] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30e1e8ee-3d67-449c-a96e-e5db11f35e2e with Priority: HIGHEST for action port [ 1144.456185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-30e1e8ee-3d67-449c-a96e-e5db11f35e2e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.456185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30e1e8ee-3d67-449c-a96e-e5db11f35e2e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.456613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30e1e8ee-3d67-449c-a96e-e5db11f35e2e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.456613] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30e1e8ee-3d67-449c-a96e-e5db11f35e2e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.456613] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30e1e8ee-3d67-449c-a96e-e5db11f35e2e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.689183] env[65231]: INFO networking_nsxv3.common.synchronization [req-32795417-a96c-452a-8bbf-df5c9db70425 req-d5078444-a6fa-4f96-809f-2ce2937ef524 service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 1144.689183] env[65231]: INFO networking_nsxv3.common.synchronization [req-32795417-a96c-452a-8bbf-df5c9db70425 req-d5078444-a6fa-4f96-809f-2ce2937ef524 service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1144.690398] env[65231]: INFO networking_nsxv3.common.synchronization [req-32795417-a96c-452a-8bbf-df5c9db70425 req-d5078444-a6fa-4f96-809f-2ce2937ef524 service nova] Enqueued Resource ID: b2ad5d98-71b8-4885-9875-1ff229fb053d with Priority: HIGHEST for action port [ 1144.690398] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 1144.691029] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1144.691029] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ad5d98-71b8-4885-9875-1ff229fb053d with Priority: HIGHEST for action port [ 1144.691242] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.691393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.691483] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.691730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.691874] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.692767] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.692907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.695940] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2ad5d98-71b8-4885-9875-1ff229fb053d taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.695940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.695940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.695940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.695940] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ad5d98-71b8-4885-9875-1ff229fb053d',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.963743] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30e1e8ee-3d67-449c-a96e-e5db11f35e2e [ 1144.963985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.964196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.964279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.964648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.964791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.964958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30e1e8ee-3d67-449c-a96e-e5db11f35e2e already deleted. [ 1144.965049] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30e1e8ee-3d67-449c-a96e-e5db11f35e2e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.195038] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.195229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.195408] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2ad5d98-71b8-4885-9875-1ff229fb053d with status ACTIVE [ 1145.195589] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.195715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.195781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.196074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.196172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.196358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.196454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.196517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.196678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.196766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.196932] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.197038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.197100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.197262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.197338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.197426] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2ad5d98-71b8-4885-9875-1ff229fb053d is going to be updated. [ 1145.228573] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.228714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.228783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.229011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.229153] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.229307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2ad5d98-71b8-4885-9875-1ff229fb053d" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.495048] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1145.495267] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 deletion is rescheduled due to dependency. [ 1145.495411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.495816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.496079] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.496300] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.496754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.496754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.496754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.496936] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.497225] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.599203] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: SUCCESS [ 1145.599437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.000423] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.503048] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.007571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.007909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.007909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.008104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.008104] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.008262] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1147.042238] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.042480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.042480] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.042647] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.042795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.053019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1147.625106] env[65231]: INFO networking_nsxv3.common.synchronization [req-e4d8d8fe-c3db-4ec4-a3a8-daacb6c715e0 req-e7eadffe-2215-4caf-9742-62adbbdf8ea4 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1147.626032] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1147.626223] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.626331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.626396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.626617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.626757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.626851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.626921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.627065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.627178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.627234] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.129473] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.129873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.129873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.129943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.129993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.130322] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.130322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.130418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.130533] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.130611] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.130700] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1148.165838] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.165838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.165838] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.166258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.166258] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.179364] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1149.066468] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1149.066732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.066861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.067114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.067382] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.067599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.067717] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.067981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.068101] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.068197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.068292] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.570481] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.074035] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 1150.093352] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.093572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.093633] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.093881] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.094015] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.094255] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.094363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.094434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.094619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.094694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.094821] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1150.172086] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.172310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.172310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.172528] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.172681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.196057] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1150.196949] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1150.196949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.201326] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1151.876238] env[65231]: INFO networking_nsxv3.common.synchronization [req-00b7e94f-181c-446b-a26b-940a65a1b3c1 req-908d87fe-44ee-44c7-9519-88cbce45fa9d tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1151.876238] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1151.876238] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.876238] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.876238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.876238] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.218195] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1152.218531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.234876] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.235159] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.235400] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.235823] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.236189] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.236371] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.236554] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.236819] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.237014] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.237254] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.237366] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.237518] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.237645] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.237762] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.237868] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.238009] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.264427] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.264589] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.264657] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.264846] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.265282] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-cef91d01-3483-4516-b305-2b660d00a72e taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.265461] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.265581] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.265919] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.266074] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef91d01-3483-4516-b305-2b660d00a72e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.379258] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.379454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.379454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.379829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.379829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.379888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.379940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.380024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.380167] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.380245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.380333] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a920363-f837-4140-baf1-68f68c922101 already deleted. [ 1152.380413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.768980] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.769205] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.769332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.769617] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.769772] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.769928] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port cef91d01-3483-4516-b305-2b660d00a72e not found, creating... [ 1152.770238] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.770395] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.770514] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.770746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.770885] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.771198] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.771390] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.771522] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.771737] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.771869] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.772018] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: cef91d01-3483-4516-b305-2b660d00a72e is going to be created. [ 1152.803326] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.803492] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.803552] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.803839] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.804078] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.804313] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.577016] env[65231]: INFO networking_nsxv3.common.synchronization [req-00b7e94f-181c-446b-a26b-940a65a1b3c1 req-a2735e0b-bccd-4f67-bb9e-f160d7d697c9 service nova] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1153.577414] env[65231]: INFO networking_nsxv3.common.synchronization [req-00b7e94f-181c-446b-a26b-940a65a1b3c1 req-a2735e0b-bccd-4f67-bb9e-f160d7d697c9 service nova] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1153.577414] env[65231]: INFO networking_nsxv3.common.synchronization [req-00b7e94f-181c-446b-a26b-940a65a1b3c1 req-a2735e0b-bccd-4f67-bb9e-f160d7d697c9 service nova] Enqueued Resource ID: cef91d01-3483-4516-b305-2b660d00a72e with Priority: HIGHEST for action port [ 1153.578099] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_rules [ 1153.578277] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1153.578408] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef91d01-3483-4516-b305-2b660d00a72e with Priority: HIGHEST for action port [ 1153.578873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.579097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.579158] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.579384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.579502] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.580492] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.580774] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.580988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.581520] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.581722] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.581858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.581947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.582197] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.582329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.582444] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.583422] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef91d01-3483-4516-b305-2b660d00a72e taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.583572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.583664] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.583852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.583961] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef91d01-3483-4516-b305-2b660d00a72e',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.087126] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.087126] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.087126] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.088326] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cef91d01-3483-4516-b305-2b660d00a72e with status ACTIVE [ 1154.088326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.088326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.088326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.088326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.088326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.088326] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.088607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.088607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.088671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.088837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.088898] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.089059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.089059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.089198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.089272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.089357] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cef91d01-3483-4516-b305-2b660d00a72e is going to be updated. [ 1154.113480] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.113635] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.113741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.113917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.114069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.114235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef91d01-3483-4516-b305-2b660d00a72e" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.282164] env[65231]: INFO networking_nsxv3.common.synchronization [req-87f46804-aa43-46a1-8c82-9eca28563643 req-9ab213a2-4e5d-4566-a3a3-05e88bb5048b tempest-ServersNegativeTestJSON-1310562200 tempest-ServersNegativeTestJSON-1310562200-project-member] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1154.282589] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGHEST for action security_group_members [ 1154.283091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.283292] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.283409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.283710] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.283924] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.284090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.284183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.284426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.284547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.284691] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.591328] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.787210] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.787371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.787442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.787672] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.787789] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.787963] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.788074] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.788137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.788309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.788361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.788855] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be updated. [ 1154.823261] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.823478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.823602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.823820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.824371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.834556] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: IN_PROGRESS for 2s [ 1154.974576] env[65231]: INFO networking_nsxv3.common.synchronization [req-1a94673a-e09b-4c90-9240-c5d9c4a792b5 req-9bf8b9af-94e0-4ae1-9891-19bf9df0b884 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1154.974888] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1154.975468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.975620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.975665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.976048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.976180] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.976318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.976494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.976656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.976800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.976952] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.095435] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.095598] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.095669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.095947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.096146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.096460] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a920363-f837-4140-baf1-68f68c922101 is going to be created. [ 1155.123518] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.123737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.123737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.123929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.124112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.135879] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: UNINITIALIZED for 2s [ 1155.303523] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.303735] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.304757] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.304757] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.304757] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.304757] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.304757] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.305039] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.305137] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.305392] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.305507] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.305617] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.305725] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.305833] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.305937] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.306360] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.331958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.331958] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.332675] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.332675] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.332859] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3e354938-91f3-4faa-930e-1c628a10ffd8 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.333062] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.333173] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.333430] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.333569] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e354938-91f3-4faa-930e-1c628a10ffd8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.480424] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.480424] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.480685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.480761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.481046] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.481141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.481337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.481386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.481792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.481792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.481792] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1155.519216] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.519448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.519510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.519727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.519913] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.530642] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1155.836706] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.837120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.837120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.837357] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.837542] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.837661] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3e354938-91f3-4faa-930e-1c628a10ffd8 not found, creating... [ 1155.837917] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.838090] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.838209] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.838428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.838563] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.838839] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.839016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.839137] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.839339] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.839480] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.839603] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3e354938-91f3-4faa-930e-1c628a10ffd8 is going to be created. [ 1155.866875] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.867120] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.867258] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.867561] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.867802] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.868050] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.613956] env[65231]: INFO networking_nsxv3.common.synchronization [req-1a94673a-e09b-4c90-9240-c5d9c4a792b5 req-9d0e2f94-8ffa-4819-b88b-1d108dca7d33 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1156.614156] env[65231]: INFO networking_nsxv3.common.synchronization [req-1a94673a-e09b-4c90-9240-c5d9c4a792b5 req-9d0e2f94-8ffa-4819-b88b-1d108dca7d33 service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1156.614294] env[65231]: INFO networking_nsxv3.common.synchronization [req-1a94673a-e09b-4c90-9240-c5d9c4a792b5 req-9d0e2f94-8ffa-4819-b88b-1d108dca7d33 service nova] Enqueued Resource ID: 3e354938-91f3-4faa-930e-1c628a10ffd8 with Priority: HIGHEST for action port [ 1156.614895] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1156.614949] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1156.615052] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e354938-91f3-4faa-930e-1c628a10ffd8 with Priority: HIGHEST for action port [ 1156.615347] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.615471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.615549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.615772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.615884] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.617122] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.617219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.617419] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e354938-91f3-4faa-930e-1c628a10ffd8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.617536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.617581] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.617739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.617814] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e354938-91f3-4faa-930e-1c628a10ffd8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.846216] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 in Status: SUCCESS [ 1156.846677] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 deletion is rescheduled due to dependency. [ 1156.846804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.119785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.120063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.120310] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e354938-91f3-4faa-930e-1c628a10ffd8 with status ACTIVE [ 1157.120498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.120630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.120707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.121024] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.121070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.121213] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.121333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.121397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.121571] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.121702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.121948] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.123091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.123091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.123091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.123091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.123091] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e354938-91f3-4faa-930e-1c628a10ffd8 is going to be updated. [ 1157.146589] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.146589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.146589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.146589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.146589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.147027] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e354938-91f3-4faa-930e-1c628a10ffd8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.147511] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: SUCCESS [ 1157.147685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.147831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.148344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.148344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.148344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.148344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.148609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.148609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.148694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.148804] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.540331] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1157.540699] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1157.540820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.540887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.541199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.541306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.541436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.541579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.541692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.541692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.541861] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.651510] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.043825] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.154403] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a920363-f837-4140-baf1-68f68c922101: rpc.has_security_group_logging(os_id): False [ 1158.180684] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.180898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.180898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.181130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.181221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.181512] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.181592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.181629] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.181780] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.181855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.181940] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a920363-f837-4140-baf1-68f68c922101 is going to be created. [ 1158.250718] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.250926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.250926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.251140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.251321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.264094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: IN_PROGRESS for 2s [ 1158.547153] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.050879] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.051500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.051500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.051500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.051500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.051692] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1159.084142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.084382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.084474] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.084653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.084804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.096368] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1160.281865] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: SUCCESS [ 1160.282156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.108626] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1161.108972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.109219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.109502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.109759] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.109939] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.110076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.110290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.110391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.110537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.110659] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.612830] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.613287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.613287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.613287] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.613456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.613550] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.613615] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.613758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.613846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.613931] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.614110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.614206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.614265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.614406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.614545] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.614628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.614683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.614819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.614895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.614977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.615121] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.616023] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.616122] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1162.117477] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1162.135596] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.135904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.135904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.136089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.136146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.136363] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.136476] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.136534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.136681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.136757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.136931] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.137040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.137091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.137234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.137308] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.137493] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.137586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.137634] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.137769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.137843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.137925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1162.203120] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.203390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.203390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.203500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.203602] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.219991] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1164.235741] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1164.236105] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.617795] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1166.618083] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.436607] env[65231]: INFO networking_nsxv3.common.synchronization [req-b3bfbecc-6909-4157-b4d6-54de83fa1688 req-19f5a413-3971-4739-a0e8-8b5f33327803 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1170.437153] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1170.437457] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.437601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.437669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.437859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.438031] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.438130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.438233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.438331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.438415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.438507] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.941085] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.941301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.941358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.941535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.941628] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.941861] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.941991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.942082] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.942241] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.942336] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.942427] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1170.990373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.990549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.990593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.990781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.990925] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.001927] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1173.012940] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1173.013347] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1173.013347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.438419] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1175.438802] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1179.184199] env[65231]: INFO networking_nsxv3.common.synchronization [req-eeeab73e-d3a1-41ce-973c-ff9f79081d82 req-71f5fdbf-7407-4ee9-8916-1efb8e25f0ff tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1179.184912] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1179.185131] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.185236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.185236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.185445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.185607] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.185719] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.185772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.185916] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.186012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.186112] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.473789] env[65231]: INFO networking_nsxv3.common.synchronization [req-96dac96d-1ab9-4462-9317-ad0494163c91 req-aa459905-fc45-4919-8107-7332cecaa2f4 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1179.474435] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1179.474901] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.475084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.475183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.475733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.475733] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.475829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.475829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.476070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.476185] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.476680] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.610909] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.611138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.611266] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.611531] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.611805] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.611965] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.612959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.612959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.612959] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.613133] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.613228] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.613326] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.613443] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.613648] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.613797] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.613906] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.640299] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.640440] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.640589] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.640757] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.641083] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-b5b295c2-301d-4aaf-8477-343a0b77ce71 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.641253] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.641370] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.641711] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.641848] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b295c2-301d-4aaf-8477-343a0b77ce71',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.689379] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.689604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.689604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.689806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.689897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.690099] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.690199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.690268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.690404] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.690471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.690554] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1179.725582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.725778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.725778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.726019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.726173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.735765] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1179.978968] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.144862] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.145238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.145479] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.145819] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.146044] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.146248] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port b5b295c2-301d-4aaf-8477-343a0b77ce71 not found, creating... [ 1180.146666] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.146846] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.146968] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.147225] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.147365] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.147760] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.147998] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.148139] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.148377] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.148521] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.148711] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: b5b295c2-301d-4aaf-8477-343a0b77ce71 is going to be created. [ 1180.169733] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.169980] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.170221] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.170499] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.170733] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.170955] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.480928] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.873142] env[65231]: INFO networking_nsxv3.common.synchronization [req-eeeab73e-d3a1-41ce-973c-ff9f79081d82 req-a16833ae-0b62-4af3-b6e0-35aad1e2080a service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1180.873325] env[65231]: INFO networking_nsxv3.common.synchronization [req-eeeab73e-d3a1-41ce-973c-ff9f79081d82 req-a16833ae-0b62-4af3-b6e0-35aad1e2080a service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1180.873512] env[65231]: INFO networking_nsxv3.common.synchronization [req-eeeab73e-d3a1-41ce-973c-ff9f79081d82 req-a16833ae-0b62-4af3-b6e0-35aad1e2080a service nova] Enqueued Resource ID: b5b295c2-301d-4aaf-8477-343a0b77ce71 with Priority: HIGHEST for action port [ 1180.873975] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1180.874185] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1180.874342] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b295c2-301d-4aaf-8477-343a0b77ce71 with Priority: HIGHEST for action port [ 1180.874725] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.874921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.875033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.875186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.875267] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.876196] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.876361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.876754] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b295c2-301d-4aaf-8477-343a0b77ce71 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.876884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.876942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.877140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.877217] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b295c2-301d-4aaf-8477-343a0b77ce71',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.984185] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.984371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.984450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.984716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.984812] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.985059] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be updated. [ 1181.023601] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.023833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.023833] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.023997] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.024154] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.032958] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 1181.379330] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.379446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.380228] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5b295c2-301d-4aaf-8477-343a0b77ce71 with status ACTIVE [ 1181.380228] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.380228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.380228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.380534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.380534] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.380776] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.380776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.380776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.381066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.381066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.381167] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.381223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.381332] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.381478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.381478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.381844] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5b295c2-301d-4aaf-8477-343a0b77ce71 is going to be updated. [ 1181.405673] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.405870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.405870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.406106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.406312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.406471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b295c2-301d-4aaf-8477-343a0b77ce71" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.749213] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1181.749213] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1181.749213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.749213] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.749785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.749785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.749785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.749785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.749785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.750019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.750019] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.252639] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.756775] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.043503] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 1183.043503] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.261087] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.261291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.261357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.261537] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.261640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.261739] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1183.291506] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.291699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.291741] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.291968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.292138] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.301737] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1185.313409] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1185.313756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.313795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.313991] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.314201] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.314319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.314385] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.314539] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.314619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.314703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.314792] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.817750] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.817750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.817750] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.817986] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.818111] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.818198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.818247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.818376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.818466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.818554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.818699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.818791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.818848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.819007] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.819149] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.819244] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.819298] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.819449] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.819527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.819606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.819693] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.874858] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.875062] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1186.321855] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1186.340198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.340431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.340431] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.340599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.340691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.340897] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.340995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.341071] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.341222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.341299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.341474] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.341580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.341678] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.341814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.341890] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.342096] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.342236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.342236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.342376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.342457] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.342536] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1186.409714] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.409971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.409971] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.410155] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.410315] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.425593] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1188.440953] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1188.441337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.875649] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.876082] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1193.260198] env[65231]: INFO networking_nsxv3.common.synchronization [req-1cc58dd4-3924-4451-96e7-18a3d6636592 req-641d3140-d257-4074-9e74-d43d4fd10d51 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1193.260724] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1193.261117] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.261250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.261311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.261499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.261652] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.261768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.261818] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.261949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.262069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.262180] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.764832] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.766558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.766674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.766904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.767007] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.767236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.767346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.767411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.767580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.767658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.767820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1193.799304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.799508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.799508] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.799660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.800471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.808094] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1194.805455] env[65231]: INFO networking_nsxv3.common.synchronization [req-7178cbe8-4184-4d2f-9ba3-18650d3c65c3 req-f5b197f0-65d4-43ae-9ae5-681133d84550 tempest-ServerActionsTestOtherA-797823484 tempest-ServerActionsTestOtherA-797823484-project-member] Enqueued Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1194.805455] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 with Priority: HIGHEST for action security_group_members [ 1194.805455] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.806188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.806367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.806661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.806937] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.807170] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.807319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.807556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.807734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.807910] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('815e1e30-e3ab-42b0-b86b-fcd2a81435a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.899967] env[65231]: INFO networking_nsxv3.common.synchronization [req-7ae99408-852a-40ee-83ef-5b6dd6c7ab31 req-f931867c-b3c5-45a7-96ca-296afeb691ec tempest-AttachVolumeShelveTestJSON-1500934865 tempest-AttachVolumeShelveTestJSON-1500934865-project-member] Enqueued Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1194.900577] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 with Priority: HIGHEST for action security_group_members [ 1194.900917] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d545a86-14ce-4276-b4f9-c746b41ad9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.901064] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.901130] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.901337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.901490] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.901590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.901651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.901795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.901882] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.901976] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d545a86-14ce-4276-b4f9-c746b41ad9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.312320] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.312512] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.312558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.312766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.312860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.313074] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.313176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.313238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.313387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.313463] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.313551] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 is going to be updated. [ 1195.358418] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.358591] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.358652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.358865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.359019] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.371516] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: IN_PROGRESS for 2s [ 1195.404281] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.404469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.404516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.404708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.404802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.405236] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.405396] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.405460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.405699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.405781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.405872] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 is going to be updated. [ 1195.441843] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.442089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.442089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.442266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.442409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.459142] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: IN_PROGRESS for 2s [ 1195.817820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1195.818077] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1195.818180] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.381895] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 in Status: SUCCESS [ 1197.382187] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 815e1e30-e3ab-42b0-b86b-fcd2a81435a2 deletion is rescheduled due to dependency. [ 1197.382804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-815e1e30-e3ab-42b0-b86b-fcd2a81435a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.469714] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 in Status: SUCCESS [ 1197.469974] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d545a86-14ce-4276-b4f9-c746b41ad9f0 deletion is rescheduled due to dependency. [ 1197.470451] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d545a86-14ce-4276-b4f9-c746b41ad9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.901644] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.901962] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.433683] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5481b4-808c-4d43-a03f-ac0710868a2b req-381a98cf-8d87-4382-ac70-82a3698b5b8c tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1203.434546] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1203.434546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.434546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.434714] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.434917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.435021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.435667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.435667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.435667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.435667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.435667] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.731663] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.731861] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.731989] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.732262] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.732511] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.732701] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.732823] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.733103] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.733302] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.733529] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.733667] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.733786] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.733892] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.734012] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.734121] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.734252] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.753856] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.754032] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1203.754160] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.754329] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-106" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.754623] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.754802] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.755020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.755527] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.755724] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.937640] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.937883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.938030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.938310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.938448] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.938708] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.938857] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.938965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.939295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.939378] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.939573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1203.980332] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.980530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.980530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.980733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.981080] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.991013] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1204.258500] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.258714] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.258843] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.259150] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.259304] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.259457] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 not found, creating... [ 1204.259716] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.259936] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.260075] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.260311] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.260458] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.260757] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.260920] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.261052] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.261261] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.261401] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.261543] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 is going to be created. [ 1204.284652] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.284895] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.285038] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.285396] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.285699] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.286651] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.023886] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5481b4-808c-4d43-a03f-ac0710868a2b req-15cb87dc-888c-4e83-8f91-f8bed1ea684b service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1205.024201] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5481b4-808c-4d43-a03f-ac0710868a2b req-15cb87dc-888c-4e83-8f91-f8bed1ea684b service nova] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1205.024282] env[65231]: INFO networking_nsxv3.common.synchronization [req-fe5481b4-808c-4d43-a03f-ac0710868a2b req-15cb87dc-888c-4e83-8f91-f8bed1ea684b service nova] Enqueued Resource ID: fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 with Priority: HIGHEST for action port [ 1205.024856] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_rules [ 1205.025045] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1205.025178] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 with Priority: HIGHEST for action port [ 1205.025978] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.026157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.026264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.026491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.026576] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.027539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.027640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.027868] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.027998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.028152] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.028314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.028411] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.530998] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.530998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.531238] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 with status ACTIVE [ 1205.531392] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.531510] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.531579] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.531842] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.531891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.532076] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.532179] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.532243] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.532398] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.532475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.532655] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.532751] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.532813] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.532953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.533040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.533127] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93 is going to be updated. [ 1205.554375] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.554563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.554606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.554795] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.554935] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.555115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa9c6f0c-ea9c-4ed7-a3bc-4954e80b6e93" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.002475] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1206.002684] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1206.002805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.002968] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.003193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.003458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.003600] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.003671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.003829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.003912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.004022] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.506865] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.009127] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.512998] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.513301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.513301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.513656] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.513727] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.513828] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1207.544686] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.544686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.544686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.544686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.544686] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.552960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1208.998640] env[65231]: INFO networking_nsxv3.common.synchronization [None req-5e489ce8-2d3e-42b6-ae95-be8914435223 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1208.999270] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1208.999600] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.999738] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.999804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.000103] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.000187] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.085372] env[65231]: INFO networking_nsxv3.common.synchronization [None req-28fd400c-cfdb-4660-af6d-4a135f78e979 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1209.085833] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1209.086207] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.086318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.521844] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.522091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.522091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.522281] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.522369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.522468] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df510a71-5195-4088-bbf5-387da7b68b33 already deleted. [ 1209.522543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.522740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.522933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.523027] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.562383] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1209.562595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.562753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.562969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.563174] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.563286] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.563352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.563497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.563575] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.563660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.563752] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.043721] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.044090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.044090] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.044326] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.044477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.044665] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df510a71-5195-4088-bbf5-387da7b68b33 already deleted. [ 1210.044745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.066459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.066609] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.066715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.066946] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.067129] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.067252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.067323] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.067477] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.067708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.067708] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.067869] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.067988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.068106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.068290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.068446] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.068543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.068604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.068772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.068855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.068937] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.069036] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.571707] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1210.591745] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.591978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.591978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.592195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.592282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.592494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.592593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.592649] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.592797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.592874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.593063] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.593157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.593217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.593355] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.593425] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.593623] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.593725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.593771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.593904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.593977] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.594088] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1210.659344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.659618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.659618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.659801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.659972] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.701023] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1212.718918] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1212.719289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.086555] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.087101] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.248964] env[65231]: INFO networking_nsxv3.common.synchronization [req-dd6f8f21-55ce-4a18-811d-bfc242ad96df req-e5082eec-7a9d-41ed-9e0f-da9a0927d672 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1215.249374] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1215.249681] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.249801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.249869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.250141] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.250303] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.250407] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.250469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.250622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.250743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.250802] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.601215] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.601413] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.601533] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.601783] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.602040] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.602196] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.602308] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.602506] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.602645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.602843] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.602953] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.603071] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.603173] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.603277] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.603377] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.603504] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.625895] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.626107] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.626280] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.626410] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.626729] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.626927] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.627061] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.627493] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.627493] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3738eeac-a1fd-42a3-81d8-2ab14a95f2af',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.754083] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.754083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.754083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.754360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.754360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.754530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.754632] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.754691] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.754837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.754912] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.754995] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df510a71-5195-4088-bbf5-387da7b68b33 already deleted. [ 1215.755087] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.129784] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.130048] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.130179] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.130460] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.130610] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.130774] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 3738eeac-a1fd-42a3-81d8-2ab14a95f2af not found, creating... [ 1216.131071] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.131237] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.131352] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.131566] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.131708] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.131979] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.132149] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.132261] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.132460] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.132589] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.132723] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 3738eeac-a1fd-42a3-81d8-2ab14a95f2af is going to be created. [ 1216.154181] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.154439] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.154509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.154796] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.155047] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.155297] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.865069] env[65231]: INFO networking_nsxv3.common.synchronization [req-dd6f8f21-55ce-4a18-811d-bfc242ad96df req-ddd11f98-81d5-435f-8b4b-79fb1cefaa3d service nova] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1216.865314] env[65231]: INFO networking_nsxv3.common.synchronization [req-dd6f8f21-55ce-4a18-811d-bfc242ad96df req-ddd11f98-81d5-435f-8b4b-79fb1cefaa3d service nova] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1216.865887] env[65231]: INFO networking_nsxv3.common.synchronization [req-dd6f8f21-55ce-4a18-811d-bfc242ad96df req-ddd11f98-81d5-435f-8b4b-79fb1cefaa3d service nova] Enqueued Resource ID: 3738eeac-a1fd-42a3-81d8-2ab14a95f2af with Priority: HIGHEST for action port [ 1216.866449] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_rules [ 1216.866582] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1216.866679] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3738eeac-a1fd-42a3-81d8-2ab14a95f2af with Priority: HIGHEST for action port [ 1216.866978] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.867123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.867188] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.867387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.867470] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.868344] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.868459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.868546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.868793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.868957] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.869077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.869140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.869289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.869433] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.869533] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.870314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.870432] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.870530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.871112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.871112] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3738eeac-a1fd-42a3-81d8-2ab14a95f2af',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.372618] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.373993] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.373993] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.373993] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3738eeac-a1fd-42a3-81d8-2ab14a95f2af with status ACTIVE [ 1217.374198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.374329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.374375] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.374564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.374685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.374883] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.374988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.375066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.375219] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.375295] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.375498] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.375620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.375734] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.376091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.376190] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.376283] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3738eeac-a1fd-42a3-81d8-2ab14a95f2af is going to be updated. [ 1217.399058] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.399313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.399313] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.399462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.399599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.399758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3738eeac-a1fd-42a3-81d8-2ab14a95f2af" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.878511] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.380561] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.380761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.380805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.381035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.381168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.381280] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df510a71-5195-4088-bbf5-387da7b68b33 is going to be created. [ 1218.414612] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.414824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.414824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.415063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.415232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.424751] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: UNINITIALIZED for 2s [ 1220.468464] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: SUCCESS [ 1220.468861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.469085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.469334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.469606] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.469792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.469898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.470148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.470247] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.470337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.470432] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.973070] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.476270] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df510a71-5195-4088-bbf5-387da7b68b33: rpc.has_security_group_logging(os_id): False [ 1221.494475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.494625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.494700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.494914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.495012] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.495263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.495366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.495430] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.495588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.495665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.495750] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df510a71-5195-4088-bbf5-387da7b68b33 is going to be created. [ 1221.556409] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.556605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.556707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.556941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.557143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.569371] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: IN_PROGRESS for 2s [ 1221.867405] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.867638] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1223.586719] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: SUCCESS [ 1223.587040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.868677] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.868903] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1227.694193] env[65231]: INFO networking_nsxv3.common.synchronization [req-12ff6654-7c11-41bc-97dc-d28be72b3abe req-89112506-1c93-4e24-abfb-5b82b6748680 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1227.694972] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1227.695668] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.695817] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.695924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.696500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.696960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.696960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.697201] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.697268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.697420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.697577] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.201220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.201547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.201547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.201640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.201735] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.201939] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.202055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.202119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.202268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.202345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.202615] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1228.232731] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.232731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.232731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.233038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.233038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.243582] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1230.254919] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1230.255357] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 deletion is rescheduled due to dependency. [ 1230.255357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.927303] env[65231]: INFO networking_nsxv3.common.synchronization [req-f902f90b-6b61-4872-b429-91099eb16492 req-bb0c245f-2d38-46aa-8bf4-61164e3ef93f tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1230.927890] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGHEST for action security_group_members [ 1230.928263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.928376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.928436] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.928648] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.928800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.928897] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.928954] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.929117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.929198] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.929291] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.432393] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.432784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.432784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.433018] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.433119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.433338] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.433446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.433509] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.433668] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.433745] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.433847] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f is going to be updated. [ 1231.463990] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.464221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.464221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.464536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.464778] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.475021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: IN_PROGRESS for 2s [ 1233.486190] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f in Status: SUCCESS [ 1233.486536] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f deletion is rescheduled due to dependency. [ 1233.486536] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.623682] env[65231]: INFO networking_nsxv3.common.synchronization [req-09d49d70-99f1-4194-b199-40c94a7949ae req-c47ec043-f842-451c-bdb0-264a3e4f752e tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1233.624247] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1233.624580] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.624718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.624783] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.625222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.625386] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.625489] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.625596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.625702] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.625785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.625902] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.129102] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.129102] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.129102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.129847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.129847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.129847] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1234.161970] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.162147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.162189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.162381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.162521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.171597] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1235.571523] env[65231]: INFO networking_nsxv3.common.synchronization [req-8331460e-18b3-46ec-b2f5-3102b164f2ce req-ff071278-cb32-4486-84e4-3224681a1a4a tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1235.571799] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 with Priority: HIGHEST for action security_group_members [ 1235.571896] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e958c59-3715-4529-9e10-dbe4830c94e6 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.572347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.572347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.572347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.572543] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.572660] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.572722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.572874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.572995] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.573120] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e958c59-3715-4529-9e10-dbe4830c94e6',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.075669] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.075895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.075895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.076273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.076387] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.076597] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.076704] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.076765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.076955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.077344] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.077344] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 is going to be updated. [ 1236.106341] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.106592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.106592] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.106786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.106877] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.117111] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: IN_PROGRESS for 2s [ 1236.181960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1236.182259] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 deletion is rescheduled due to dependency. [ 1236.182259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.344558] env[65231]: INFO networking_nsxv3.common.synchronization [req-8b5fc5d2-b1e0-4f91-9106-793f833600ee req-b069671d-e789-4c20-892d-f9ca7ba81e2d tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1237.345111] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1237.345448] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.345573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.345640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.345827] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.345976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.346135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.346182] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.346322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.346411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.346504] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.677627] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.677822] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.677958] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.678370] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.678665] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.678896] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.679182] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.679281] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.679458] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.679694] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.679829] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.679959] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.680115] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.680257] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.680396] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.680554] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.700926] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.701228] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1237.701536] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.701747] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-63" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.702071] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-5fe8d679-5809-4a72-870b-15695e80885a taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.702247] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.702366] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.702680] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.702814] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe8d679-5809-4a72-870b-15695e80885a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.848127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.848291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.848369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.848565] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.848680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.848853] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.848952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.849021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.849173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.849252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.849337] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1237.876270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.876445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.876485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.876681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.876822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.886722] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1238.097516] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1238.097668] env[65231]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d06bb8e8-65e5-4392-bb4f-f9b44d8bad97 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1238.126951] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 in Status: SUCCESS [ 1238.127191] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e958c59-3715-4529-9e10-dbe4830c94e6 deletion is rescheduled due to dependency. [ 1238.127314] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e958c59-3715-4529-9e10-dbe4830c94e6" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.205647] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.205886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.205886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.206280] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.206430] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.206596] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 5fe8d679-5809-4a72-870b-15695e80885a not found, creating... [ 1238.206848] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.207025] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.207144] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.207354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.207481] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.207759] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.207911] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.208109] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.208344] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.208490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.208636] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 5fe8d679-5809-4a72-870b-15695e80885a is going to be created. [ 1238.229686] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.230018] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.230093] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.230343] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.230571] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.230801] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.979586] env[65231]: INFO networking_nsxv3.common.synchronization [req-8b5fc5d2-b1e0-4f91-9106-793f833600ee req-3fb6bc35-8094-4aed-8a07-061752d79a11 service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 1238.979586] env[65231]: INFO networking_nsxv3.common.synchronization [req-8b5fc5d2-b1e0-4f91-9106-793f833600ee req-3fb6bc35-8094-4aed-8a07-061752d79a11 service nova] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1238.979586] env[65231]: INFO networking_nsxv3.common.synchronization [req-8b5fc5d2-b1e0-4f91-9106-793f833600ee req-3fb6bc35-8094-4aed-8a07-061752d79a11 service nova] Enqueued Resource ID: 5fe8d679-5809-4a72-870b-15695e80885a with Priority: HIGHEST for action port [ 1238.980702] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_rules [ 1238.980974] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1238.981277] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe8d679-5809-4a72-870b-15695e80885a with Priority: HIGHEST for action port [ 1238.982142] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.983975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.983975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.983975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.983975] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.985163] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.985383] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.985699] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe8d679-5809-4a72-870b-15695e80885a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.986052] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.986257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.987706] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.987706] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe8d679-5809-4a72-870b-15695e80885a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.486491] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.486651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.489157] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fe8d679-5809-4a72-870b-15695e80885a with status ACTIVE [ 1239.489389] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.489855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.489855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.489855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.489855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.490091] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.490148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.490227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.490353] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.490460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.490684] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.491115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.491115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.491115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.491115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.491256] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fe8d679-5809-4a72-870b-15695e80885a is going to be updated. [ 1239.524357] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.524357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.524544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.524627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.524769] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.524929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe8d679-5809-4a72-870b-15695e80885a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.896360] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1239.896562] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 deletion is rescheduled due to dependency. [ 1239.896646] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.896814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.897041] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.897254] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.897380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.897445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.897604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.897683] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.897778] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.050577] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.050577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.050577] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.050999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.050999] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.399912] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.553862] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.902964] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.056040] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.405755] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.405978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.406061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.406329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.406419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.406832] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1241.431790] env[65231]: INFO networking_nsxv3.common.synchronization [None req-f13f9c13-a007-4234-aa7e-364e13dfe37d tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1241.432294] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1241.432660] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.432806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.432910] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.433245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.433337] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.436345] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.436488] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.436797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.436797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.436872] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.446122] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1241.530635] env[65231]: INFO networking_nsxv3.common.synchronization [None req-a56f7476-81a3-449d-86a5-054c723c78ab tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1241.531221] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1241.531558] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.531658] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.559279] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1241.559279] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1241.963711] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.963711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.963711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.963711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.963711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.964043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 already deleted. [ 1241.964043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.964043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.964803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.964803] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.071141] env[65231]: INFO networking_nsxv3.common.synchronization [req-9756232c-7c61-4057-bcf7-d34df5558ad8 req-4d783717-b572-4cdf-9d3e-c3b6a661fc70 tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1242.071678] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1242.071985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.072143] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.072221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.072412] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.072566] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.072665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.072999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.072999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.072999] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.072999] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.322653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.323254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.323254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.323254] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.337859] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1242.338846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.340090] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1242.382347] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.382529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.382608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.382884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.400189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.400189] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1242.400189] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1242.400378] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1242.444985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.445199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.445199] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.445410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.447317] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.447502] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1242.486988] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.486988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.486988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.486988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.486988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.486988] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 already deleted. [ 1242.486988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.542976] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.543173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.543255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.543469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.543807] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.544162] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1242.576024] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.629358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.629559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.629604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.629830] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.630172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.630494] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1242.630641] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ef5784cc-7357-491d-87fc-9e86cfa66f0a', '46aaaa81-68ab-4e7d-baa6-29897d6cee13', '45d0c669-d29b-4033-86e4-fdbf9e070f07', '07ae4197-f0b5-42cc-83f2-b8f0bb199776', 'bcecc58c-6471-4f02-a7e2-fe8324893375', '3a77ea6c-8279-4404-bdc2-a6401a557a16', '5d879c7b-7d8f-43cc-b0af-c07876f057bf', '9fa3219f-3c1b-4d8f-9164-408ce5ede9d2', 'e84a3002-4115-443b-93ae-8ea2f36a04a2', 'd87cdd94-ecdf-4643-9622-6c738c69cd1f', '1e382486-015d-44b8-a3e5-a0f228b61242', 'a2257478-c27b-4343-b984-1f77e61bf69f', '1f698486-5433-4f5d-838f-8989284e2ed7', '43373c35-f1da-468d-a81a-368c06b022b4', '869acb51-f00a-446a-b29b-f2bb797e9d19', 'd76eb4ea-4e07-4f87-8e4f-58cae3b3eccd', '01960bce-f3a7-4830-a96e-89dc3cc30754', 'dab779d2-9149-4b17-970e-1cc363dd590f', '048f7577-8ddf-44da-9165-34de6c108c3b', '2b54578a-a5d1-4189-a2be-ff086c792902', '6d545a86-14ce-4276-b4f9-c746b41ad9f0', '3effb6bd-b711-484f-a4bf-1ecdf2a28db6', '9389aaed-1ad6-48d4-af15-236c6a035cba', '089102e4-f74e-4139-88d6-a79e9f27e9c1', '66588024-bc1b-4c51-8e2d-4b20cabf9055', 'a7635576-86a3-4c1e-879c-905a9e43f478', 'f59524d0-6c69-4693-8189-3ea92184056b', 'e78acfd0-0636-44da-8f92-638d0b04c956', '6a920363-f837-4140-baf1-68f68c922101', 'df510a71-5195-4088-bbf5-387da7b68b33', 'ee4dd131-77b2-4914-aa5f-9f4b5de030a2', 'd28923db-4093-40f3-b394-1a2f62eeee3d', '01685928-70c6-4a4e-8584-3fbdbe9910e3', '891aab68-a374-48cb-ac40-546cb8e3fe02', '1bcea4e4-2c8c-4878-89e4-515969ca794c', '86218e2b-505b-489d-9831-63e52af66c10', 'e6430736-9ff5-460b-bc23-c5a9b4bcafe0', '2e958c59-3715-4529-9e10-dbe4830c94e6', 'c2d80f7f-757f-4f15-9618-2e66c9f29176', 'e543173b-3aa1-49c7-bec7-ab450397ef46', '815e1e30-e3ab-42b0-b86b-fcd2a81435a2', '8b152afd-9129-4bd3-b47d-6533ebe5e687', 'cee33745-1169-4666-835e-545451997389', '4930f591-dad9-4803-8936-7b21d9dabe55', 'b1183b41-14a7-418b-9e37-1cfcc5aec444', 'a3040d0e-55de-46b1-b5fb-234c0b6b3c67', '8c7c7dcc-21d1-45b3-b34e-4d29c652aefb', 'b384100c-460b-4c13-8f1d-ec90af9ef06d', 'e07d317b-0483-4445-8dd5-93a55bfaf9ae'} {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1242.630740] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1242.658110] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.658384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.658384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.658621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.658709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.658824] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1242.658891] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1242.659017] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1242.759207] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.759487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.759487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.759775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.761724] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.762183] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1242.762338] env[65231]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65231) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1242.762462] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1242.762573] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1242.762701] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1242.762935] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 1242.763027] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGH for action security_group_rules [ 1242.763230] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGH for action security_group_rules [ 1242.763425] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 1242.763535] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGH for action security_group_rules [ 1242.763693] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGH for action security_group_rules [ 1242.763766] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGH for action security_group_rules [ 1242.763894] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGH for action security_group_rules [ 1242.763998] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 1242.764098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGH for action security_group_rules [ 1242.764183] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGH for action security_group_rules [ 1242.764269] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGH for action security_group_rules [ 1242.764354] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 1242.764456] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGH for action security_group_rules [ 1242.764535] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGH for action security_group_rules [ 1242.764620] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGH for action security_group_rules [ 1242.764705] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGH for action security_group_rules [ 1242.764792] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGH for action security_group_rules [ 1242.764877] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGH for action security_group_rules [ 1242.764961] env[65231]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGH for action security_group_rules [ 1242.765135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.079105] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.456267] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1243.456589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.456707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.456903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.457184] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.457359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.457359] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.457525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.457603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.457687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.457790] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.581560] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.581723] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.581797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.582026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.582136] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.582237] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1243.616198] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.616397] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.616674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.616674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.616846] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.626216] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1243.960425] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.379110] env[65231]: INFO networking_nsxv3.common.synchronization [req-62f950d9-7dc5-43d1-aa95-06463430810f req-d98a0396-038d-408d-92d0-98f73994787a tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1244.379677] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1244.379836] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a with Priority: HIGH for action security_group_rules [ 1244.379969] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 with Priority: HIGH for action security_group_rules [ 1244.380095] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf with Priority: HIGH for action security_group_rules [ 1244.380209] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 with Priority: HIGH for action security_group_rules [ 1244.380296] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b54578a-a5d1-4189-a2be-ff086c792902 with Priority: HIGH for action security_group_rules [ 1244.380386] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048f7577-8ddf-44da-9165-34de6c108c3b with Priority: HIGH for action security_group_rules [ 1244.380482] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab779d2-9149-4b17-970e-1cc363dd590f with Priority: HIGH for action security_group_rules [ 1244.380570] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 with Priority: HIGH for action security_group_rules [ 1244.380653] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43373c35-f1da-468d-a81a-368c06b022b4 with Priority: HIGH for action security_group_rules [ 1244.380738] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd with Priority: HIGH for action security_group_rules [ 1244.380832] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f698486-5433-4f5d-838f-8989284e2ed7 with Priority: HIGH for action security_group_rules [ 1244.380929] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGH for action security_group_rules [ 1244.381098] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382486-015d-44b8-a3e5-a0f228b61242 with Priority: HIGH for action security_group_rules [ 1244.381171] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f with Priority: HIGH for action security_group_rules [ 1244.381258] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGH for action security_group_rules [ 1244.381358] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 with Priority: HIGH for action security_group_rules [ 1244.381438] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGH for action security_group_rules [ 1244.381525] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcecc58c-6471-4f02-a7e2-fe8324893375 with Priority: HIGH for action security_group_rules [ 1244.381607] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGH for action security_group_rules [ 1244.381692] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 with Priority: HIGH for action security_group_rules [ 1244.382016] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.382233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.382346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.382620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.382795] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.382899] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.382958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.383159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.383245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.383335] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.384243] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.384377] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.384441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.384614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.384702] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5784cc-7357-491d-87fc-9e86cfa66f0a',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.385852] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d0c669-d29b-4033-86e4-fdbf9e070f07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.385960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.386017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.386793] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.386793] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d0c669-d29b-4033-86e4-fdbf9e070f07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.387996] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.387996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.387996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.387996] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.387996] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d879c7b-7d8f-43cc-b0af-c07876f057bf',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.388244] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-869acb51-f00a-446a-b29b-f2bb797e9d19 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.388343] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.388386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.388563] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.388636] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('869acb51-f00a-446a-b29b-f2bb797e9d19',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.390066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b54578a-a5d1-4189-a2be-ff086c792902 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.390066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.391366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.391366] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.391366] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b54578a-a5d1-4189-a2be-ff086c792902',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.391617] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-048f7577-8ddf-44da-9165-34de6c108c3b taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.392032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.392032] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.392144] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.392490] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('048f7577-8ddf-44da-9165-34de6c108c3b',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.393564] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab779d2-9149-4b17-970e-1cc363dd590f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.393564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.393564] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.394500] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.394500] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab779d2-9149-4b17-970e-1cc363dd590f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.395349] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01960bce-f3a7-4830-a96e-89dc3cc30754 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.397320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.397320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.397320] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.397320] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01960bce-f3a7-4830-a96e-89dc3cc30754',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.398290] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43373c35-f1da-468d-a81a-368c06b022b4 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.398290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.398290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.398290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.398290] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43373c35-f1da-468d-a81a-368c06b022b4',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.399456] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.399456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.399456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.399675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.399675] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.400354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f698486-5433-4f5d-838f-8989284e2ed7 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.400443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.400443] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.401189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.401189] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f698486-5433-4f5d-838f-8989284e2ed7',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.402215] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.402215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.402215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.402395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.402395] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.404033] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e382486-015d-44b8-a3e5-a0f228b61242 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.404033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.404033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.404033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.404033] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e382486-015d-44b8-a3e5-a0f228b61242',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.404858] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.404965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.405085] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.405252] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.405297] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87cdd94-ecdf-4643-9622-6c738c69cd1f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.406032] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.406211] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.406641] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a77ea6c-8279-4404-bdc2-a6401a557a16 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.406641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.406641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.406816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.406851] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a77ea6c-8279-4404-bdc2-a6401a557a16',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.407894] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.408523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.408523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.408523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.408523] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.409421] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcecc58c-6471-4f02-a7e2-fe8324893375 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.409543] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.409642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.409821] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.409899] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcecc58c-6471-4f02-a7e2-fe8324893375',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.410689] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.410802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.410854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.411114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.411242] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.414271] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.414271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.414544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.414544] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.414822] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ae4197-f0b5-42cc-83f2-b8f0bb199776',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.423090] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.423265] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.423402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.423651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.446311] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.446486] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.447960] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.448149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.452849] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.452849] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.455471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.455471] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.455471] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.455667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.455701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.455804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.455853] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1244.456799] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.456969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.462251] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 1244.478757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.478927] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d879c7b-7d8f-43cc-b0af-c07876f057bf is going to be deleted. [ 1244.479836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.480059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.481522] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.481671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.489037] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.489255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.489415] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.489620] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.489764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.498101] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1244.500410] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.500714] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5784cc-7357-491d-87fc-9e86cfa66f0a is going to be deleted. [ 1244.501962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.501962] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.521498] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.521655] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab779d2-9149-4b17-970e-1cc363dd590f is going to be deleted. [ 1244.522645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.522884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.547033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.547369] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.547491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.547561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.547760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.547843] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.547930] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1244.552171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.552361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.552361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.552529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.552779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.552779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d879c7b-7d8f-43cc-b0af-c07876f057bf" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.567643] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.567840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.567840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.568029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.568117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.568233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5784cc-7357-491d-87fc-9e86cfa66f0a" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.578152] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.578328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.578372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.578764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.578887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.578966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab779d2-9149-4b17-970e-1cc363dd590f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.628605] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.628824] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.628923] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.629208] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.629420] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.658043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1244.738428] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.738428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.738428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.738715] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.738820] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.738976] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.739106] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.739321] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.739460] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.739664] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.739774] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.739880] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.739987] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.740129] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.740303] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.740455] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.772920] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.773146] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.773242] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.773419] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.773733] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.773907] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.774156] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.774505] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.774640] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17fea9d-5e1d-405c-b2be-6f3956c2fe47',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.917399] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.917586] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.921313] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.921438] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.921506] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.921703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.921855] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.921955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.922033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.922172] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.922256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.922340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.922422] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.955974] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.956299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.956299] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.956469] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.961469] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.961637] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.962345] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.962442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.963104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.963186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.968652] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.968828] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.969963] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.970077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.973945] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.974108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.974847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.974942] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.976607] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.976713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.977513] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.977599] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.979756] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.979858] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.980483] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1244.980888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.980980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.982477] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1244.982887] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.983038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.983859] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1244.984272] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.984367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.987316] env[65231]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1244.987869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.987869] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b54578a-a5d1-4189-a2be-ff086c792902 is going to be deleted. [ 1244.988845] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.989132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.007123] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.007291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd is going to be deleted. [ 1245.008140] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.008369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.027753] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.027905] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d0c669-d29b-4033-86e4-fdbf9e070f07 is going to be deleted. [ 1245.028841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.029168] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.057917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.058084] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a77ea6c-8279-4404-bdc2-a6401a557a16 is going to be deleted. [ 1245.059059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.059284] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.059371] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.059471] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be deleted. [ 1245.060917] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.061142] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.061266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.061484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.061601] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.061781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b54578a-a5d1-4189-a2be-ff086c792902" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.062686] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.062820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.062921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.063161] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.063280] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.063441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76eb4ea-4e07-4f87-8e4f-58cae3b3eccd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.063650] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.063873] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.082406] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.082533] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43373c35-f1da-468d-a81a-368c06b022b4 is going to be deleted. [ 1245.083743] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.083978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.100752] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.100918] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.111665] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.111820] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e382486-015d-44b8-a3e5-a0f228b61242 is going to be deleted. [ 1245.112716] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.112927] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.134696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.134925] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 048f7577-8ddf-44da-9165-34de6c108c3b is going to be deleted. [ 1245.135761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.136234] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.137466] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.137585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.147599] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.147768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.159947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.160105] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01960bce-f3a7-4830-a96e-89dc3cc30754 is going to be deleted. [ 1245.160983] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.161237] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.194696] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.194887] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.195461] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.195551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.199373] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.199488] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 869acb51-f00a-446a-b29b-f2bb797e9d19 is going to be deleted. [ 1245.200360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.200569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.241121] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.241301] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.263938] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.264151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.272417] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.272563] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcecc58c-6471-4f02-a7e2-fe8324893375 is going to be deleted. [ 1245.273466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.273681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.276813] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.277056] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.277252] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.277624] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.277774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.277931] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port f17fea9d-5e1d-405c-b2be-6f3956c2fe47 not found, creating... [ 1245.278237] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.278404] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.278522] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.278829] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.278917] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.279185] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.279340] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.279454] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.279662] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.279794] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.279931] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 is going to be created. [ 1245.362228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.362451] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f698486-5433-4f5d-838f-8989284e2ed7 is going to be deleted. [ 1245.363347] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.364340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.368123] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.368342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.368534] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.368809] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.369053] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.369282] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.427301] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.427713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.427713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.427819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.427927] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.428047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.428115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.428273] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.428837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.428837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.428837] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.428837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.428837] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.429092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.429092] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.429186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.429249] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.429386] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.429462] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.429541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.429632] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.438199] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.438354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.671969] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.671969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.672549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.672670] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ae4197-f0b5-42cc-83f2-b8f0bb199776 is going to be deleted. [ 1245.673555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.673763] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.686040] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1245.686040] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.686278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.686497] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.686686] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.686832] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.686902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.687083] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.687174] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.687260] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.687350] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.719720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.719720] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87cdd94-ecdf-4643-9622-6c738c69cd1f is going to be deleted. [ 1245.720874] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.721115] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.721230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.721365] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d0c669-d29b-4033-86e4-fdbf9e070f07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.721527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.721695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.721771] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.721883] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a77ea6c-8279-4404-bdc2-a6401a557a16" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.722513] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.722616] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.722699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.722815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.722947] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.723132] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.723236] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.723372] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43373c35-f1da-468d-a81a-368c06b022b4" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.723547] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.723709] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.723787] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.723900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e382486-015d-44b8-a3e5-a0f228b61242" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.724036] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.724178] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.724255] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.724356] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-048f7577-8ddf-44da-9165-34de6c108c3b" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.724478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.724614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.724688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.724801] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01960bce-f3a7-4830-a96e-89dc3cc30754" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.724922] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.725070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.725146] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.725256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-869acb51-f00a-446a-b29b-f2bb797e9d19" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.725393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.725529] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.725605] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.725711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcecc58c-6471-4f02-a7e2-fe8324893375" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.739653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.739653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.739653] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.739988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.739988] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.741035] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f698486-5433-4f5d-838f-8989284e2ed7" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.822043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.822043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.822043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.822264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.822294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.822414] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ae4197-f0b5-42cc-83f2-b8f0bb199776" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.888103] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.888290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.888367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.888607] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.888707] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.888851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87cdd94-ecdf-4643-9622-6c738c69cd1f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.932456] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2257478-c27b-4343-b984-1f77e61bf69f: rpc.has_security_group_logging(os_id): False [ 1245.966760] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.966917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.966966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.967316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.988697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.989019] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.989151] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.989222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.989541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.989541] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.989797] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.989797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.989978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.989978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.990195] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.990232] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.990328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.990525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.990699] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.990779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.990866] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1246.027713] env[65231]: INFO networking_nsxv3.common.synchronization [req-62f950d9-7dc5-43d1-aa95-06463430810f req-1100fbfd-d5f0-4b3d-adbc-5a037cc565b2 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1246.027911] env[65231]: INFO networking_nsxv3.common.synchronization [req-62f950d9-7dc5-43d1-aa95-06463430810f req-1100fbfd-d5f0-4b3d-adbc-5a037cc565b2 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1246.028061] env[65231]: INFO networking_nsxv3.common.synchronization [req-62f950d9-7dc5-43d1-aa95-06463430810f req-1100fbfd-d5f0-4b3d-adbc-5a037cc565b2 service nova] Enqueued Resource ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with Priority: HIGHEST for action port [ 1246.028720] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1246.028866] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1246.028972] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with Priority: HIGHEST for action port [ 1246.029287] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.029713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.029713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.029713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.029858] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.030785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.030902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.031158] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.031294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.031363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.031549] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.031627] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17fea9d-5e1d-405c-b2be-6f3956c2fe47',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.070115] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.070297] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.070338] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.070530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.070681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.087291] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1246.189586] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.189806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.189806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.190042] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.190220] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.190391] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.190485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.190640] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.190749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.190840] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.190985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.191112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.191175] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.191322] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.191462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.191561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.191627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.191766] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.191860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.191949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.192060] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.509902] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1246.510290] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 deletion is rescheduled due to dependency. [ 1246.510290] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.510382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.510675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.511034] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.511034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.511034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.511272] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.511374] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.511473] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.535361] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.535361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.536195] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with status ACTIVE [ 1246.536351] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.536980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.536980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.536980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.536980] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.536980] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.537210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.537210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.537328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.537328] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.537521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.537621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.537681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.537867] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.537911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.537986] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 is going to be updated. [ 1246.557298] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.557481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.557481] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.557688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.557820] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.557976] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.682425] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1246.682662] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.682851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.683097] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.683191] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.694163] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2: rpc.has_security_group_logging(os_id): False [ 1246.713484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.713721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.713721] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.713888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.736855] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.737171] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.737329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.737399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.737618] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.737703] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.737934] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.738118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.738227] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.738478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.738614] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.738819] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.738911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.738974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.739268] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.739349] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.739442] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1246.804416] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.804625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.804625] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.804814] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.804957] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.817164] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1247.013368] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.185493] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.186147] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.186147] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.186384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.186384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.186454] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.186532] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.186619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.186737] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.519396] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.690404] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.022064] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.022259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.022312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.022596] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.022711] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.022847] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1248.060524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.060776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.060876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.061134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.061291] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.071733] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1248.104439] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1248.104652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.191240] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e84a3002-4115-443b-93ae-8ea2f36a04a2: rpc.has_security_group_logging(os_id): False [ 1248.212178] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.212382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.212382] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.212606] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.212700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.212953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.213072] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.213139] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.213296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.213376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.213465] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1248.273747] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.273891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.273943] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.274310] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.274466] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.288797] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1248.833793] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1248.834222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.083056] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1250.083479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.083479] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.084271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.084271] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.084271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.084271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.084271] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.084574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.084574] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.084574] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.189851] env[65231]: INFO networking_nsxv3.common.synchronization [req-a4e80974-6466-4ac9-bf87-9408473a511a req-4b7f0df5-43e4-455f-a201-8e8b65446cd0 tempest-ServerRescueNegativeTestJSON-748892789 tempest-ServerRescueNegativeTestJSON-748892789-project-member] Enqueued Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1250.190427] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 with Priority: HIGHEST for action security_group_members [ 1250.190742] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.190865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.190933] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.191148] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.191306] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.191419] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.191461] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.191604] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.191685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.191778] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa3219f-3c1b-4d8f-9164-408ce5ede9d2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.308167] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1250.308395] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.586492] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.606798] env[65231]: INFO networking_nsxv3.common.synchronization [req-d7fcdea2-b909-47e2-92e6-c5e177cc4b24 req-74beb119-23a2-4b3c-9c47-8efba0841681 tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1250.607424] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1250.607739] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.607854] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.607919] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.608221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.608725] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.608725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.608725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.608725] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.608969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.608969] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.694552] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.694775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.694775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.694948] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.695055] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.695256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.695358] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.695418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.695569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.695685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.695741] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 is going to be updated. [ 1250.726919] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.727229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.727229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.727401] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.727556] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.737463] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: IN_PROGRESS for 2s [ 1250.757514] env[65231]: INFO networking_nsxv3.common.synchronization [req-dcd66d58-943f-476e-93e6-ca1d238ce333 req-a85dc2e5-6d43-41c4-be36-e76a5b9c8ee5 tempest-DeleteServersTestJSON-314540722 tempest-DeleteServersTestJSON-314540722-project-member] Enqueued Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1250.758704] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2257478-c27b-4343-b984-1f77e61bf69f with Priority: HIGHEST for action security_group_members [ 1250.759237] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2257478-c27b-4343-b984-1f77e61bf69f taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.759333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.759422] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.759685] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.759888] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.760037] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.760129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.760334] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.760455] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.760719] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2257478-c27b-4343-b984-1f77e61bf69f',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.954847] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.955123] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.955295] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.955623] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.955918] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.956131] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.956310] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.956576] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.956771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.956992] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1250.957117] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.957250] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.957359] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.957467] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1250.957572] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.957704] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.977374] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.977557] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1250.977694] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.977835] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-536" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.978167] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-0251ccb2-e290-4094-9c59-0c4da49d3a07 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.978342] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.978459] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.978798] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.978936] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0251ccb2-e290-4094-9c59-0c4da49d3a07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.090312] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46aaaa81-68ab-4e7d-baa6-29897d6cee13: rpc.has_security_group_logging(os_id): False [ 1251.108990] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.109165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.109230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.109442] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.109531] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.109763] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.109865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.109926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.110089] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.110165] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.110252] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be created. [ 1251.111433] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.111542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.111608] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.111779] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.111860] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.112049] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.112150] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.112212] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.112352] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.112426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.112509] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 already deleted. [ 1251.112590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.170132] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.170421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.170421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.170663] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.170896] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.184428] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1251.262525] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.262687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.262759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.262979] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.263086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.263278] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.263379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.263441] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.263583] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.263671] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.263755] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f is going to be updated. [ 1251.339189] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.339413] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.339467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.339770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.339958] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.351172] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: IN_PROGRESS for 2s [ 1251.481636] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.481860] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.481989] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.482486] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.482486] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.482602] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 0251ccb2-e290-4094-9c59-0c4da49d3a07 not found, creating... [ 1251.482844] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.483016] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.483108] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.483421] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.483490] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.483782] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.483949] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.484082] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.484292] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.484427] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.484562] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 0251ccb2-e290-4094-9c59-0c4da49d3a07 is going to be created. [ 1251.508247] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.508512] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.508605] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.508913] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.509268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.509507] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.210953] env[65231]: INFO networking_nsxv3.common.synchronization [req-d7fcdea2-b909-47e2-92e6-c5e177cc4b24 req-6f83829d-5d5b-439c-a87c-a42a3d21b548 service nova] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1252.211204] env[65231]: INFO networking_nsxv3.common.synchronization [req-d7fcdea2-b909-47e2-92e6-c5e177cc4b24 req-6f83829d-5d5b-439c-a87c-a42a3d21b548 service nova] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1252.211412] env[65231]: INFO networking_nsxv3.common.synchronization [req-d7fcdea2-b909-47e2-92e6-c5e177cc4b24 req-6f83829d-5d5b-439c-a87c-a42a3d21b548 service nova] Enqueued Resource ID: 0251ccb2-e290-4094-9c59-0c4da49d3a07 with Priority: HIGHEST for action port [ 1252.211485] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_rules [ 1252.211608] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1252.211704] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0251ccb2-e290-4094-9c59-0c4da49d3a07 with Priority: HIGHEST for action port [ 1252.212314] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.212452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.212521] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.212757] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.212855] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.213790] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.213982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.213982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.214269] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.214429] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.214530] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.214593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.214739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.214823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.214917] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.217176] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-0251ccb2-e290-4094-9c59-0c4da49d3a07 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.217309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.217376] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.217560] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.217637] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0251ccb2-e290-4094-9c59-0c4da49d3a07',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.720092] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.720727] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.720829] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.720992] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0251ccb2-e290-4094-9c59-0c4da49d3a07 with status ACTIVE [ 1252.721168] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.721309] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.721367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.721555] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.722475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.722475] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.722475] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.722805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.722805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.722805] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.722889] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0251ccb2-e290-4094-9c59-0c4da49d3a07 is going to be updated. [ 1252.750098] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 in Status: SUCCESS [ 1252.750272] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa3219f-3c1b-4d8f-9164-408ce5ede9d2 deletion is rescheduled due to dependency. [ 1252.750388] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa3219f-3c1b-4d8f-9164-408ce5ede9d2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.751539] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.751667] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.751797] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.751961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.752076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.752217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0251ccb2-e290-4094-9c59-0c4da49d3a07" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.199413] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1253.199784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.225354] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.364656] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2257478-c27b-4343-b984-1f77e61bf69f in Status: SUCCESS [ 1253.364873] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2257478-c27b-4343-b984-1f77e61bf69f deletion is rescheduled due to dependency. [ 1253.365342] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2257478-c27b-4343-b984-1f77e61bf69f" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.729114] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.729114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.729114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.729114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.729114] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.729114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 is going to be created. [ 1253.756616] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.756841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.756841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.757048] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.757256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.782750] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: UNINITIALIZED for 2s [ 1255.793813] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: SUCCESS [ 1255.794229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.794229] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.794390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.794582] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.794701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.794764] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.794911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.794992] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.795091] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.795181] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.298096] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.800233] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 411ce888-2903-4b5e-89b0-87e58daf9969: rpc.has_security_group_logging(os_id): False [ 1256.820021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.820021] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.820021] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.820021] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 is going to be created. [ 1256.887501] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.887645] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.887692] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.887895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.888278] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.901513] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: IN_PROGRESS for 2s [ 1257.212311] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.212470] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.916167] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: SUCCESS [ 1258.916644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.214042] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.214437] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.234151] env[65231]: INFO networking_nsxv3.common.synchronization [req-d3dae09e-0fa4-45b5-83e4-9f2167f06466 req-eda8955e-1b87-4abd-af4c-46894a2a63e9 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1264.235621] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df510a71-5195-4088-bbf5-387da7b68b33 with Priority: HIGHEST for action security_group_members [ 1264.235621] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-df510a71-5195-4088-bbf5-387da7b68b33 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.235621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.235768] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.235998] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.236066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.236122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.236561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.236561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.236561] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.236561] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df510a71-5195-4088-bbf5-387da7b68b33',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.739072] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.739296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.739296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.739525] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.761276] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.761554] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.761680] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.761748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.761955] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.762061] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.762156] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df510a71-5195-4088-bbf5-387da7b68b33 is going to be updated. [ 1264.786454] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.786654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.786654] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.786876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.787029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.795441] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: IN_PROGRESS for 2s [ 1266.808081] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df510a71-5195-4088-bbf5-387da7b68b33 in Status: SUCCESS [ 1266.808468] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df510a71-5195-4088-bbf5-387da7b68b33 deletion is rescheduled due to dependency. [ 1266.808468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df510a71-5195-4088-bbf5-387da7b68b33" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.235817] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.236049] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.237496] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.238077] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.603748] env[65231]: INFO networking_nsxv3.common.synchronization [req-dd984cce-3548-4c72-98b5-3427d88443f3 req-e5dcf6d0-66aa-4295-9351-d6c6c862aad7 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1275.604308] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a920363-f837-4140-baf1-68f68c922101 with Priority: HIGHEST for action security_group_members [ 1275.604634] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a920363-f837-4140-baf1-68f68c922101 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.604749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.604819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.605518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.605518] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.605518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.605518] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.605831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.605831] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.605831] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a920363-f837-4140-baf1-68f68c922101',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.109135] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.109135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.109135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.109135] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.129974] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.130235] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.130357] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.130426] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.130636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.130720] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.130809] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a920363-f837-4140-baf1-68f68c922101 is going to be updated. [ 1276.157066] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.157311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.157311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.157553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.157765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.167114] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: IN_PROGRESS for 2s [ 1278.177497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a920363-f837-4140-baf1-68f68c922101 in Status: SUCCESS [ 1278.177914] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a920363-f837-4140-baf1-68f68c922101 deletion is rescheduled due to dependency. [ 1278.177914] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a920363-f837-4140-baf1-68f68c922101" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.250390] env[65231]: INFO networking_nsxv3.common.synchronization [None req-c37c9775-a1ad-4b59-b334-402b7a407dcf tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1280.250939] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1280.251226] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.251333] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.251405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.251674] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.251755] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.337096] env[65231]: INFO networking_nsxv3.common.synchronization [None req-9b6efd58-f56e-4e15-8052-8707cca9c1aa tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1280.337096] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1280.337355] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.337456] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.773270] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.773465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.773465] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.773669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.773759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.773849] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 already deleted. [ 1280.773929] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.774092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.774240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.774320] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.294354] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.294701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.294701] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.294804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.294905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.295010] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 already deleted. [ 1281.295098] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.338341] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.338341] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.692692] env[65231]: INFO networking_nsxv3.common.synchronization [req-d13fb87d-bc50-404f-ab24-eeb555bebc15 req-3aec155e-0c64-48b2-b9e4-4403fc4ee2d5 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1285.692899] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1285.693337] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.693337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.693458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.693638] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.693800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.693900] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.694043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.694116] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.694200] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.694291] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.946040] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.946234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.946234] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.946466] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.946749] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.946903] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.947026] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.947236] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.947377] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.947581] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1285.948053] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1285.948183] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1285.948292] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1285.948408] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1285.948518] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1285.948650] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1285.975993] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1285.976243] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1285.976391] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1285.976645] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.977024] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-7ffc9f86-7e17-47fd-9f13-62378732caa8 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.977238] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.977384] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.977774] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.977933] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffc9f86-7e17-47fd-9f13-62378732caa8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.196256] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.196380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.196460] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.196739] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.196836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.197057] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.197159] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.197221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.197370] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.197446] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.197557] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 already deleted. [ 1286.197675] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.480258] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.480620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.480620] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.481017] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.481214] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.481380] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Segment Port 7ffc9f86-7e17-47fd-9f13-62378732caa8 not found, creating... [ 1286.481693] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.481876] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.481993] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.482243] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.482379] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.482676] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.482872] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.482994] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.483221] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.483374] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.483527] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: 7ffc9f86-7e17-47fd-9f13-62378732caa8 is going to be created. [ 1286.626219] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.626634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.626634] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.626935] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.627196] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.627428] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.187924] env[65231]: INFO networking_nsxv3.common.synchronization [req-d13fb87d-bc50-404f-ab24-eeb555bebc15 req-e2646556-32c5-4f46-b252-776604ef961c service nova] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1287.188134] env[65231]: INFO networking_nsxv3.common.synchronization [req-d13fb87d-bc50-404f-ab24-eeb555bebc15 req-e2646556-32c5-4f46-b252-776604ef961c service nova] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1287.188262] env[65231]: INFO networking_nsxv3.common.synchronization [req-d13fb87d-bc50-404f-ab24-eeb555bebc15 req-e2646556-32c5-4f46-b252-776604ef961c service nova] Enqueued Resource ID: 7ffc9f86-7e17-47fd-9f13-62378732caa8 with Priority: HIGHEST for action port [ 1287.188842] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_rules [ 1287.188965] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1287.189204] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffc9f86-7e17-47fd-9f13-62378732caa8 with Priority: HIGHEST for action port [ 1287.189504] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.189630] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.189697] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.189902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.189998] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.191303] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.191546] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.191627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.191811] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.191953] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.192059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.192119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.192316] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.192369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.192418] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.193799] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffc9f86-7e17-47fd-9f13-62378732caa8 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.193905] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.194124] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.194296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.194372] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffc9f86-7e17-47fd-9f13-62378732caa8',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.692151] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.692652] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.694802] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.696404] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ffc9f86-7e17-47fd-9f13-62378732caa8 with status ACTIVE [ 1287.696710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.696866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.696960] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.697238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.697361] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.697597] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.697737] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.697822] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.698836] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.699011] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.699318] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.699698] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.699819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.700904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.700904] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.700904] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ffc9f86-7e17-47fd-9f13-62378732caa8 is going to be updated. [ 1287.722309] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.722522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.722522] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.722758] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.722898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.723066] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffc9f86-7e17-47fd-9f13-62378732caa8" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.202562] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.705062] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.705499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.705499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.705844] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.705921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.706036] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 is going to be created. [ 1288.743445] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.743730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.743803] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.744084] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.744337] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.755118] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: UNINITIALIZED for 2s [ 1290.767019] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: SUCCESS [ 1290.767427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.767427] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.767700] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.768259] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.768259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.768259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.768259] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.768490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.768490] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.768568] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.271438] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.774407] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 458d89d5-2c21-4052-abcc-aaa71df1de29: rpc.has_security_group_logging(os_id): False [ 1291.792994] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.793217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.793217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.793485] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.793593] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.793873] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.793981] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.794065] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.794235] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.794311] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.794397] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 is going to be created. [ 1291.855985] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.856257] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.856335] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.856552] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.856815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.870666] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: IN_PROGRESS for 2s [ 1292.190471] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.190638] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1293.883683] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: SUCCESS [ 1293.884017] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.192135] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.192455] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.248886] env[65231]: INFO networking_nsxv3.common.synchronization [req-39006c7a-e512-4ed9-a038-3e017a6cf2c0 req-9dfd9452-7668-43c4-98ee-0182196e7f33 tempest-ServerActionsTestJSON-1865263438 tempest-ServerActionsTestJSON-1865263438-project-member] Enqueued Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1301.249459] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 with Priority: HIGHEST for action security_group_members [ 1301.249814] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-e84a3002-4115-443b-93ae-8ea2f36a04a2 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.249940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.250030] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.250340] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.250508] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.250636] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.250693] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.250852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.250932] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.251034] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e84a3002-4115-443b-93ae-8ea2f36a04a2',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.753710] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.753950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.753950] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.754223] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.754331] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.754530] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.754644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.754754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.754945] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.755329] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.755329] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 is going to be updated. [ 1301.785476] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.785742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.785742] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.785909] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.786077] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.795507] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: IN_PROGRESS for 2s [ 1303.809254] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 in Status: SUCCESS [ 1303.809642] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e84a3002-4115-443b-93ae-8ea2f36a04a2 deletion is rescheduled due to dependency. [ 1303.809642] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e84a3002-4115-443b-93ae-8ea2f36a04a2" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.250884] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.251239] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.514833] env[65231]: INFO networking_nsxv3.common.synchronization [None req-e8dac1b9-e917-4e9d-93af-e30fcc1baab5 None None] Enqueued Resource ID: 54d68ebe-c8e6-4c6e-842e-728154cbfc60 with Priority: HIGHEST for action port [ 1310.515419] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d68ebe-c8e6-4c6e-842e-728154cbfc60 with Priority: HIGHEST for action port [ 1310.515757] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-54d68ebe-c8e6-4c6e-842e-728154cbfc60 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.515864] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54d68ebe-c8e6-4c6e-842e-728154cbfc60" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.515911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54d68ebe-c8e6-4c6e-842e-728154cbfc60" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.516183] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54d68ebe-c8e6-4c6e-842e-728154cbfc60" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.516267] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54d68ebe-c8e6-4c6e-842e-728154cbfc60',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.020443] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54d68ebe-c8e6-4c6e-842e-728154cbfc60 [ 1311.020657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.020798] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.020861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.021102] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.021192] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.021287] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54d68ebe-c8e6-4c6e-842e-728154cbfc60 already deleted. [ 1311.021891] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54d68ebe-c8e6-4c6e-842e-728154cbfc60" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.516994] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.517390] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.392609] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.392931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.392931] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.393206] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.393503] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.393636] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.393977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.393977] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.394138] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.394360] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1318.394467] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1318.394621] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1318.394681] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1318.394810] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1318.394933] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1318.395096] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1318.416739] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1318.417259] env[65231]: DEBUG dogpile.cache.region [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1318.417259] env[65231]: DEBUG dogpile.lock [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1318.417354] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "network-867" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.417610] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.417795] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.417916] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.418227] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.418617] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17fea9d-5e1d-405c-b2be-6f3956c2fe47',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.922521] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.922777] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.922777] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.923099] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.923267] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.923546] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.923700] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.923815] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.924081] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.924180] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.924451] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.924602] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.924714] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.924979] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.925135] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.925271] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Resource: SegmentPort with ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 is going to be updated. [ 1318.946282] env[65231]: DEBUG networking_nsxv3.common.locking [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.946518] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.946637] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.946847] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.947102] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.947333] env[65231]: DEBUG oslo_concurrency.lockutils [None req-5c1331ef-4f99-48a2-99ab-a1c7d4d58213 None None] Releasing lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.656128] env[65231]: INFO networking_nsxv3.common.synchronization [req-bbe2df34-3e27-4641-a7d3-319f6787121d req-4d8c8f83-b306-4a59-a610-8b8fa29f9b89 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1319.656128] env[65231]: INFO networking_nsxv3.common.synchronization [req-bbe2df34-3e27-4641-a7d3-319f6787121d req-4d8c8f83-b306-4a59-a610-8b8fa29f9b89 service nova] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1319.656128] env[65231]: INFO networking_nsxv3.common.synchronization [req-bbe2df34-3e27-4641-a7d3-319f6787121d req-4d8c8f83-b306-4a59-a610-8b8fa29f9b89 service nova] Enqueued Resource ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with Priority: HIGHEST for action port [ 1319.656662] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_rules [ 1319.656811] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1319.656948] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with Priority: HIGHEST for action port [ 1319.657373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.657499] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.657582] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.657792] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.657875] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.659744] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.659859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.659917] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.660232] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.660394] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.660495] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.660558] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.660736] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.660810] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.660903] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.662163] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.662380] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.662478] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.663062] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.663062] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17fea9d-5e1d-405c-b2be-6f3956c2fe47',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.160765] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.161033] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.162486] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.164427] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f17fea9d-5e1d-405c-b2be-6f3956c2fe47 with status ACTIVE [ 1320.164740] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.164975] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.165108] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.165428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.165569] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.165861] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.166134] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.166222] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.166411] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.166554] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.166869] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.167437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.167437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.167437] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.167622] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.167675] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f17fea9d-5e1d-405c-b2be-6f3956c2fe47 is going to be updated. [ 1320.198340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.198580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.198580] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.198761] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.198888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.199076] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f17fea9d-5e1d-405c-b2be-6f3956c2fe47" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.665485] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.168514] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.168770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.168770] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.168876] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.168965] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.169081] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1321.198864] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.199107] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.199193] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.199346] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.199491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.213069] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1323.231423] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1323.231841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.231841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.232047] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.232248] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.232369] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.232434] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.232587] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.232666] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.232754] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.232842] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.735451] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.237880] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46aaaa81-68ab-4e7d-baa6-29897d6cee13: rpc.has_security_group_logging(os_id): False [ 1324.256468] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.256696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.256696] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.257023] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.257173] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.257431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.257553] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.257619] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.257791] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.257869] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.258061] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1324.318154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.318399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.318399] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.318641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.318806] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.334294] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1324.657941] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.658186] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1326.358122] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1326.358122] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.659448] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.659983] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.715582] env[65231]: INFO networking_nsxv3.common.synchronization [req-888149c2-d564-4a37-aa38-dd6e6555e81f req-4e9a89f9-8198-42b5-9d6c-96042ca9a7a7 tempest-AttachVolumeTestJSON-322424885 tempest-AttachVolumeTestJSON-322424885-project-member] Enqueued Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1329.716250] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411ce888-2903-4b5e-89b0-87e58daf9969 with Priority: HIGHEST for action security_group_members [ 1329.716571] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-411ce888-2903-4b5e-89b0-87e58daf9969 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.716715] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.717217] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.717657] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.717657] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.717903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.717903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.718086] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.718240] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.718421] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('411ce888-2903-4b5e-89b0-87e58daf9969',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.221056] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.221056] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.221527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.221527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.221527] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.221635] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.221694] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.221759] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.221907] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.221985] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.222087] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 is going to be updated. [ 1330.255160] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.255409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.255409] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.255595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.255784] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.266960] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: IN_PROGRESS for 2s [ 1332.278610] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 411ce888-2903-4b5e-89b0-87e58daf9969 in Status: SUCCESS [ 1332.278610] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 411ce888-2903-4b5e-89b0-87e58daf9969 deletion is rescheduled due to dependency. [ 1332.278610] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-411ce888-2903-4b5e-89b0-87e58daf9969" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.717018] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.717384] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.076818] env[65231]: INFO networking_nsxv3.common.synchronization [req-3cd43be9-0b5f-4c5e-a879-a139f626469e req-25b3a136-198c-4209-8a0d-2bba01b75cd0 tempest-ServerActionsTestOtherB-969796456 tempest-ServerActionsTestOtherB-969796456-project-member] Enqueued Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1338.077439] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 with Priority: HIGHEST for action security_group_members [ 1338.077775] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-46aaaa81-68ab-4e7d-baa6-29897d6cee13 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.077940] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.078038] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.078279] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.078437] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.078585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.078673] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.078859] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.079118] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.079118] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46aaaa81-68ab-4e7d-baa6-29897d6cee13',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.582521] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.582760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.582760] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.582961] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.583070] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.583293] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.583418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.583473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.583627] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.583705] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.583806] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 is going to be updated. [ 1338.609870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.610113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.610113] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.610238] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.610379] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.618678] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: IN_PROGRESS for 2s [ 1340.631265] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 in Status: SUCCESS [ 1340.631514] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46aaaa81-68ab-4e7d-baa6-29897d6cee13 deletion is rescheduled due to dependency. [ 1340.631669] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46aaaa81-68ab-4e7d-baa6-29897d6cee13" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.078152] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.078471] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.078844] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.079139] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.830599] env[65231]: INFO networking_nsxv3.common.synchronization [req-d063fe67-dc6d-4f5c-aa54-1d5828e25599 req-2dc6751f-4a20-4734-b278-d1e60e4387e5 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1349.831217] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 with Priority: HIGHEST for action security_group_members [ 1349.831458] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-458d89d5-2c21-4052-abcc-aaa71df1de29 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.831584] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.831659] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.831848] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.832020] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.832804] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.832924] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.833206] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.833367] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.833627] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('458d89d5-2c21-4052-abcc-aaa71df1de29',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.060596] env[65231]: INFO networking_nsxv3.common.synchronization [None req-5a3adda4-bbfa-4645-a177-569d9a77ea60 None None] Enqueued Resource ID: 5fe3ec9e-56e2-4a02-ac6b-96abd52a9056 with Priority: HIGHEST for action port [ 1350.060920] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe3ec9e-56e2-4a02-ac6b-96abd52a9056 with Priority: HIGHEST for action port [ 1350.061264] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe3ec9e-56e2-4a02-ac6b-96abd52a9056 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.061416] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe3ec9e-56e2-4a02-ac6b-96abd52a9056" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.061468] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe3ec9e-56e2-4a02-ac6b-96abd52a9056" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.061722] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe3ec9e-56e2-4a02-ac6b-96abd52a9056" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.061801] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe3ec9e-56e2-4a02-ac6b-96abd52a9056',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.336161] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.336294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.336294] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.336501] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.336595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.336800] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.336886] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.336953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.337128] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.337264] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.337447] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 is going to be updated. [ 1350.376741] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.376895] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.376978] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.377176] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.377381] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.386428] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: IN_PROGRESS for 2s [ 1350.564575] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fe3ec9e-56e2-4a02-ac6b-96abd52a9056 [ 1350.565529] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.565765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.565823] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.566016] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.566119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.566217] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fe3ec9e-56e2-4a02-ac6b-96abd52a9056 already deleted. [ 1350.566303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe3ec9e-56e2-4a02-ac6b-96abd52a9056" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.123568] env[65231]: INFO networking_nsxv3.common.synchronization [None req-591528ff-459a-4fae-8862-09e75b07765b None None] Enqueued Resource ID: 9bfc4a9d-3bb7-496f-a9f4-df7b236071bd with Priority: HIGHEST for action port [ 1352.124121] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfc4a9d-3bb7-496f-a9f4-df7b236071bd with Priority: HIGHEST for action port [ 1352.124426] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bfc4a9d-3bb7-496f-a9f4-df7b236071bd taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.124551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bfc4a9d-3bb7-496f-a9f4-df7b236071bd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.124621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bfc4a9d-3bb7-496f-a9f4-df7b236071bd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.124926] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bfc4a9d-3bb7-496f-a9f4-df7b236071bd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.125030] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfc4a9d-3bb7-496f-a9f4-df7b236071bd',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.397687] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 in Status: SUCCESS [ 1352.398053] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 458d89d5-2c21-4052-abcc-aaa71df1de29 deletion is rescheduled due to dependency. [ 1352.398053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-458d89d5-2c21-4052-abcc-aaa71df1de29" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.627082] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bfc4a9d-3bb7-496f-a9f4-df7b236071bd [ 1352.628100] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.628100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.628100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.628100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.628100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.628100] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bfc4a9d-3bb7-496f-a9f4-df7b236071bd already deleted. [ 1352.628100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bfc4a9d-3bb7-496f-a9f4-df7b236071bd" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.794104] env[65231]: INFO networking_nsxv3.common.synchronization [None req-13739a6b-3cfc-45ef-b614-94fd4600d56f tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1354.794104] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1354.794104] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.796802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.796802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.796802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.796802] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.872475] env[65231]: INFO networking_nsxv3.common.synchronization [None req-fad57b05-5be9-422b-9948-d4de06759bee tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1354.872475] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1354.872619] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.872731] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.316541] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.316718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.316767] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.316969] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.317069] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.317162] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 already deleted. [ 1355.317245] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.317421] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.317572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.317654] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.838549] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.838851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.838851] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.838966] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.839092] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.839195] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 already deleted. [ 1355.839282] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.774791] env[65231]: INFO networking_nsxv3.common.synchronization [req-20c2ed50-80d4-4aa9-a05e-f320e2435470 req-b62db119-fd62-4033-943c-ebadd97fd177 tempest-ServerAddressesTestJSON-1195872194 tempest-ServerAddressesTestJSON-1195872194-project-member] Enqueued Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1356.775292] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1356.775597] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.775718] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.775785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.776034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.776194] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.776296] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.776360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.776507] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.776589] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.776681] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.047361] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.047361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-752" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.047361] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-752" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.047787] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-752" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.047787] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.047912] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.048020] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.048242] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.048399] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.048591] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.048698] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1357.048803] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1357.048970] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1357.049034] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.049123] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1357.049249] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1357.067372] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1357.067541] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1357.067647] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1357.067841] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-752" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.068148] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-69427a2b-0f4b-4b97-aa10-7b8343052457 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.068314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.068433] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.068725] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.068856] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69427a2b-0f4b-4b97-aa10-7b8343052457',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.279546] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.279740] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.279785] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.280088] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.280210] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.280431] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.280588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.280588] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.280786] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.280884] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.280988] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 already deleted. [ 1357.281112] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.571455] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.571699] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.571809] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.572195] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.572404] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.572595] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port 69427a2b-0f4b-4b97-aa10-7b8343052457 not found, creating... [ 1357.572922] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.573127] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.573280] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.573539] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.573707] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.574054] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.574254] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.574405] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.574641] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.574802] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.574969] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: 69427a2b-0f4b-4b97-aa10-7b8343052457 is going to be created. [ 1357.595018] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.595289] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.595387] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.595633] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.595864] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.596102] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.281545] env[65231]: INFO networking_nsxv3.common.synchronization [req-20c2ed50-80d4-4aa9-a05e-f320e2435470 req-6089ad5b-d444-426f-8165-14fe56f503b8 service nova] Enqueued Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_rules [ 1358.281803] env[65231]: INFO networking_nsxv3.common.synchronization [req-20c2ed50-80d4-4aa9-a05e-f320e2435470 req-6089ad5b-d444-426f-8165-14fe56f503b8 service nova] Enqueued Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1358.281911] env[65231]: INFO networking_nsxv3.common.synchronization [req-20c2ed50-80d4-4aa9-a05e-f320e2435470 req-6089ad5b-d444-426f-8165-14fe56f503b8 service nova] Enqueued Resource ID: 69427a2b-0f4b-4b97-aa10-7b8343052457 with Priority: HIGHEST for action port [ 1358.282649] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_rules [ 1358.282811] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1358.282914] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69427a2b-0f4b-4b97-aa10-7b8343052457 with Priority: HIGHEST for action port [ 1358.283260] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.283458] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.283572] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.283878] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.283964] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.285121] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.285250] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.285321] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.285491] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.285638] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.285733] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.285796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.285938] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.286034] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.286128] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.286847] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-69427a2b-0f4b-4b97-aa10-7b8343052457 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.286952] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.287029] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.287181] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.287254] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69427a2b-0f4b-4b97-aa10-7b8343052457',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.788879] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.789215] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.789268] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.790159] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69427a2b-0f4b-4b97-aa10-7b8343052457 with status ACTIVE [ 1358.790340] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.790452] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.790517] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.790713] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.790800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.790966] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.792043] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.792043] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.792043] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69427a2b-0f4b-4b97-aa10-7b8343052457 is going to be updated. [ 1358.813127] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.813303] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.813350] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.813523] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.813661] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.813816] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69427a2b-0f4b-4b97-aa10-7b8343052457" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.294519] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.796646] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.796901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.796901] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.797137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.797228] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.797360] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 is going to be created. [ 1359.820857] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.821068] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.821119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.821330] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.821487] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.830313] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: UNINITIALIZED for 2s [ 1360.179791] env[65231]: INFO networking_nsxv3.common.synchronization [req-39a863ca-9258-4b8d-bec6-4edf1fdcd645 req-63290774-6e83-40e8-a621-3c95575ff69e tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1360.179955] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1360.180154] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.180277] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.180345] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.180603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.180762] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.180865] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.180949] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.181221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.181319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.181419] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.512904] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.513268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.513268] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.513494] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.513738] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.513886] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.514009] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.514472] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.514626] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.514831] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1360.514941] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] NeedRegenerationException {{(pid=65231) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.515059] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] no value, waiting for create lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.515165] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] value creation lock acquired {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.515270] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] No value present for key: 'zone-id' {{(pid=65231) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1360.515376] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Calling creation function for not-yet-present value {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.515508] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1360.532341] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1360.532500] env[65231]: DEBUG dogpile.cache.region [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65231) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1360.532634] env[65231]: DEBUG dogpile.lock [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Released creation lock {{(pid=65231) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1360.532796] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "network-410" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.533095] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9 taken with stack trace [, , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.533260] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.533380] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.533682] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.533816] env[65231]: DEBUG networking_nsxv3.api.rpc [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82cdddd-4600-439b-9e9d-3fafcf3a59e9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.683561] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.683765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.683765] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.683941] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.684060] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.684263] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.684363] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.684428] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.684573] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.684651] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.684735] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 already deleted. [ 1360.684815] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.035898] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.036181] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.036314] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.036600] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.036746] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.036897] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Segment Port d82cdddd-4600-439b-9e9d-3fafcf3a59e9 not found, creating... [ 1361.037171] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.037380] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.037509] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.037733] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.037868] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.038162] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.038332] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.038437] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.038640] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.038771] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.038907] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Resource: SegmentPort with ID: d82cdddd-4600-439b-9e9d-3fafcf3a59e9 is going to be created. [ 1361.058498] env[65231]: DEBUG networking_nsxv3.common.locking [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.058697] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.058824] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.059088] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.059317] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.059538] env[65231]: DEBUG oslo_concurrency.lockutils [None req-e41d3699-5d58-46eb-ada7-f2e6191f9c49 None None] Releasing lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.728748] env[65231]: INFO networking_nsxv3.common.synchronization [req-39a863ca-9258-4b8d-bec6-4edf1fdcd645 req-be0e2e34-bebc-428f-ade8-6881a7264a53 service nova] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1361.729059] env[65231]: INFO networking_nsxv3.common.synchronization [req-39a863ca-9258-4b8d-bec6-4edf1fdcd645 req-be0e2e34-bebc-428f-ade8-6881a7264a53 service nova] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1361.729393] env[65231]: INFO networking_nsxv3.common.synchronization [req-39a863ca-9258-4b8d-bec6-4edf1fdcd645 req-be0e2e34-bebc-428f-ade8-6881a7264a53 service nova] Enqueued Resource ID: d82cdddd-4600-439b-9e9d-3fafcf3a59e9 with Priority: HIGHEST for action port [ 1361.730367] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_rules [ 1361.730630] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1361.730882] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82cdddd-4600-439b-9e9d-3fafcf3a59e9 with Priority: HIGHEST for action port [ 1361.731396] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.731796] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.731885] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.732196] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.732318] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.735059] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.735059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.735059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.736304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.736304] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.736304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.736304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.736304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.736304] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.736304] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.737551] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.737730] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.737852] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.738095] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.738230] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82cdddd-4600-439b-9e9d-3fafcf3a59e9',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.840062] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: SUCCESS [ 1361.840230] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.840402] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.840644] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.840833] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.840953] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.841026] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.841186] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.841266] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.841354] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.841445] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.240404] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.240551] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.240722] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.241604] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d82cdddd-4600-439b-9e9d-3fafcf3a59e9 with status ACTIVE [ 1362.241785] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.241898] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.241964] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.242459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.242459] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.242459] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.242617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.242617] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.242695] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.242772] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.242947] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.243050] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.243110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.243246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.243318] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.243421] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d82cdddd-4600-439b-9e9d-3fafcf3a59e9 is going to be updated. [ 1362.266337] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.266494] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.266540] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.266746] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.266903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.267129] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d82cdddd-4600-439b-9e9d-3fafcf3a59e9" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.344463] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.344749] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.344888] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.345256] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.345570] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.345732] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.345841] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.346110] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.346262] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.346418] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.346653] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.346802] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.346903] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.347137] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.347358] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.347450] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.347516] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.347687] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.347776] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.347863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.347956] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.745783] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.850625] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2192c85-7a0c-4d7a-a1b0-23a620aeb564: rpc.has_security_group_logging(os_id): False [ 1362.869664] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.869915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.869915] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.870096] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.870187] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.870373] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.870472] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.870535] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.870681] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.870756] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.870947] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.871053] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.871106] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.871246] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.871319] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.871494] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.871585] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.871641] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.871775] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.871847] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.871930] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 is going to be created. [ 1362.927803] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.928063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.928063] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.928220] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.928445] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.938396] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: IN_PROGRESS for 2s [ 1363.248089] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.248289] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.248473] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.248595] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.248712] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.248712] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 is going to be created. [ 1363.272857] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.273189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.273189] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.273360] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.273502] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.283049] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: UNINITIALIZED for 2s [ 1365.090802] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: SUCCESS [ 1365.091233] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.292191] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: SUCCESS [ 1365.292405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.292562] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.292781] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.292970] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.293100] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.293156] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.293307] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.293384] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.293467] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.293577] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.796199] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.298806] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b81068d-a478-42c9-abe4-332e22f1c9f0: rpc.has_security_group_logging(os_id): False [ 1366.315703] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.315908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.315908] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.316119] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.316203] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.316442] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.316542] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.316603] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.316748] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.316819] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.316900] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 is going to be created. [ 1366.379462] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.379676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.379676] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.379866] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.380059] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.390911] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: IN_PROGRESS for 2s [ 1366.732034] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.732276] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.386245] env[65231]: INFO networking_nsxv3.common.synchronization [req-547d2d99-2058-441e-9969-96580d2fcf1f req-5c817969-85d6-409f-ab4e-3276737f964c tempest-ServerAddressesTestJSON-1195872194 tempest-ServerAddressesTestJSON-1195872194-project-member] Enqueued Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1368.386504] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 with Priority: HIGHEST for action security_group_members [ 1368.386777] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.387393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.387393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.387393] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.387393] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.387690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.387690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.387690] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.387788] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.387824] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2192c85-7a0c-4d7a-a1b0-23a620aeb564',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.406365] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: SUCCESS [ 1368.406590] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.890626] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.890800] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.890861] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.891125] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.891221] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.891567] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.891688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.891747] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.891902] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.891982] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.892086] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 is going to be updated. [ 1368.920870] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.920870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.920870] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.921390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.921390] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.930995] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: IN_PROGRESS for 2s [ 1370.945145] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 in Status: SUCCESS [ 1370.945559] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2192c85-7a0c-4d7a-a1b0-23a620aeb564 deletion is rescheduled due to dependency. [ 1370.945559] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2192c85-7a0c-4d7a-a1b0-23a620aeb564" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.387795] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.388217] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.389422] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.389789] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.390553] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.390926] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.392138] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.392138] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.393258] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.393582] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.394414] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.394810] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.395539] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.395822] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.396675] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.397141] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.398124] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.398419] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.399645] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.400043] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.173637] env[65231]: INFO networking_nsxv3.common.synchronization [req-e38b1a57-c477-4fa9-ac5a-60133cdf131b req-ce8171e2-a37c-479c-a5d9-240b0d315ed6 tempest-AttachVolumeNegativeTest-1168901181 tempest-AttachVolumeNegativeTest-1168901181-project-member] Enqueued Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1423.174524] env[65231]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 with Priority: HIGHEST for action security_group_members [ 1423.174524] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b81068d-a478-42c9-abe4-332e22f1c9f0 taken with stack trace [, , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.174688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.174688] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.174863] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.175484] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.175484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.175484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.175484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.175484] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.175484] env[65231]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b81068d-a478-42c9-abe4-332e22f1c9f0',) {} {{(pid=65231) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.678141] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.678405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.678405] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.678570] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.678621] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.678823] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.678921] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.678984] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.679149] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.679225] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.679309] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 is going to be updated. [ 1423.715681] env[65231]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65231) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.715911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.715911] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.716157] env[65231]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.716312] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.724497] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: IN_PROGRESS for 2s [ 1425.739632] env[65231]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 in Status: SUCCESS [ 1425.740117] env[65231]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b81068d-a478-42c9-abe4-332e22f1c9f0 deletion is rescheduled due to dependency. [ 1425.740117] env[65231]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b81068d-a478-42c9-abe4-332e22f1c9f0" {{(pid=65231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.175511] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.175971] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.176449] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.176852] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.177131] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.177607] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.178429] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.178842] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.179036] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.179411] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.180452] env[65231]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.180834] env[65231]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0